America’s Dad is having a very bad week. A few days ago, Barbara Bowman wrote a personal essay in The Washington Post chronicling how Bill Cosby drugged and raped her 30 years ago.

The story went viral and inspired several others to echo her experiences.

Not so when the teenager spoke out soon after the alleged attacks: When she went to a lawyer after the assaults, she was accused of lying. Her agent did nothing, either. Eventually, she moved on. Years later, Andrea Constand accused Cosby of rape and Bowman was asked to speak in court, but the case was quietly settled.

At this writing, a grand total of 15 women have accused Cosby of assault, dating from the late 1960s. (Here’s a timeline of the accusations.) Despite all this, Cosby’s career had coasted along—in fact, he was awarded the Mark Twain Prize for American Humor not long ago and was planning a new TV show.

But things are changing.

Finally, the accusers’ stories are getting traction. Why now? Last month, comedian Hannibal Buress called Cosby a rapist in his stand-up routine, which went viral. The Twitter-verse responded in kind: Last week, Cosby’s tone-deaf invitation to “meme me!” resulted in people superimposing assault accusations over his photo. #Cosbymeme did not go according to plan, and things only got worse: Last weekend, NPR interviewed him about his African American art collection and then asked him to respond to the Post story. He went silent. Eventually, his lawyer issued a statement firmly denying the allegations and refusing to comment further.

But the damage has been done: New stories about Cosby’s behavior continue to surface, Netflix has put his upcoming comedy special on hold, and NBC has abandoned plans to develop a new sitcom with him.

Why Accusations About Celebrities Aren’t Believed

Cosby isn’t the first icon to be accused of sexual assault or domestic violence, and yet the question persists: Why aren’t these accusers heard or given any credence—not just Cosby’s alleged victims, but the countless other people who have dared to challenge a celebrity?

The answer lies in the American conflation of celebrity and security, says Ulester Douglas, executive director of Men Stopping Violence. “We are a celebrity culture. Seeing someone we idolize, revere, and idealize being accused of horrific crimes makes us wonder: Who are we? It makes us realize that our own families could be capable of it, too,” he says. It’s unsettling and even terrifying to associate an idol with evil, particularly because there are so many celebrities who are good people, capable of powerful, positive influence.

Dissonance Perpetuates Silence

David Adams is a psychologist and co-director of Emerge, a Boston-based abusers’ intervention and counseling program. He sees a difference in how we respond to a stereotypical criminal and a celebrity accused of bad behavior due to our preconceptions about abusers. “We tend to think of an abuser as someone who is easily detectable: someone who is crude, sexist, and boorish. A quarter of men who abuse women do fit this stereotype, and since that’s a substantial subgroup, we tend to spot those guys and not the ones who are more likable. If we don’t know what to do with bad information about someone we adore, it creates dissonance, and we sometimes choose to disbelieve or to ignore it,” he says.

“When we see someone likable accused of a crime, we have a choice to believe something bad about them or to discount it because it doesn’t fit our experience. In some ways it’s easier to do that than to think, oh God, the world really is unknowable—I might as well give up on knowing people,” he says. “If we don’t know what to do with information about someone we worship, we put it aside.”

Why Celebrities Feel Immune

Of course, Cosby is hardly the first famous person to be accused of rape or assault. When we think about any celebrity facing serious allegations, though, it’s difficult to believe that an image-conscious idol could be willing to engage in hugely risky behavior, throwing away the very image they need. What’s going through their mind?

“Any consequence is overridden by the high of the conquest,” Douglas says. And, on a purely logistical level, “They do it because they can. They truly think they can get away with it, based on the very fact that they have a certain image. They will be believed; the accusers will be laughed out of the room.”

Absorbing The Narcissism Factor

In many celebrity cases, narcissism also plays a starring role. “A hallmark of narcissism is exceptionality. You literally think you will not get caught. This personality takes chances, acts reckless, and even associates the behavior with success, because they’ve always been rewarded,” Adams says.

“We think narcissists are people nobody would like. But, in fact, they’re quite charismatic, with good social and image-maintenance skills”— which often allow them to get away with bad behavior, even more so when there’s a PR team on call. Narcissists are also skilled at compartmentalization, Adams says, and they choose to focus on the “part of their life that everybody adores. They don’t focus on other parts of their lives, and if they do something wrong, they think, ‘Gee, everybody loves me. What’s the problem?’” he says. “It’s a lack of character development.”

“Narcissists can engage in all sorts of psychological gymnastics not to feel empathy,” says Douglas.

The Changing Tide

Adams says that it’s easy to categorize personalities as good versus bad. “We don’t think good and evil can co-exist in the same person,” he says. “But look at the Mafia—these guys who do horrible things but are notoriously good to their mothers. And along comes a show like The Sopranos to paint them in a more nuanced light. There’s now less focus on ‘good guys’ and ‘bad guys,’” he says. Understanding the complexities of personalities—refusing to glorify a celebrity as all good, all the time—could help to close the dissonance gap.

“We can also go a long way toward preventing male sexual and domestic violence against women by stopping the pervasive and pernicious victim-blaming,” Douglas says. “The media, for example, should quit asking the toxic, ‘Why did you go back to your abuser?’ and ‘Why didn’t you leave?’ A reporter could say instead, ‘As you know, there are some who question your credibility because of some of the choices you made. What, if anything, would you want to say to them?’ That is respectful journalism. The [accuser] should never be made to feel like she has to justify the choices she made or makes.”

Finally, in his own work with Men Stopping Violence, Douglas sees firsthand the power of healing through sharing. “I see survivors who are finding peace through coming forward and telling their stories. One of the most powerful things that survivors can do is tell their own stories, on their own terms,” he says.