Who are the mysterious people who've created the 21st century sex panics, which revolve around the explosive headline of "sex trafficking"? There's a new notion, promogated by these vice patrollers, that anyone who packs a suitcase and has sex is part of a nefarious sex slavery ring, or that any person who places an adult ad is part of pedophiliac cult.
In the following story, Nick Pinto investigates the forces that targeted CraigsList with great success, and are all too eager to close down every manifestation of sex work and free speech they can get their hands on. There's precious little investigation into this movement, and I was pleased to get my hands on this reporting. —Worth the whole read!
Attorneys representing CraigsList told Congress last September that their ubiquitous Web classifieds site was closing its adult section.
Under intense scrutiny from the government and crusading advocacy groups, as well as state attorneys general, owner Craig Newmark memorably applied the label "Censored" in his classifieds where adult advertising once appeared.
Story by Nick Pinto, reprinted with permission of Author and CityPages
During the same September hearing of a subcommittee of the House Judiciary, members of Congress listened to vivid and chilling accounts regarding underage prostitution.
The congressmen heard testimony from half a dozen nonprofit executives and law enforcement officials.
But the most alarming words of the day came from Deborah Richardson, the chief program officer of the Women's Funding Network. She told legislators that juvenile prostitution is exploding at an astronomical rate.
"An independent tracking study released today by the Women's Funding Network shows that over the past six months, the number of underage girls trafficked online has risen exponentially in three diverse states," Richardson claimed. "Michigan: a 39.2 percent increase; New York: a 20.7 percent increase; and Minnesota: a staggering 64.7 percent increase."
In the wake of this bombshell revelation, Richardson's disturbing figures found their way into some of the biggest newspapers in the country. USA Today, the Houston Chronicle, the Miami Herald, the Minneapolis Star Tribune, and the Detroit Free Press all repeated the dire statistics as gospel.
The successful assault on Craigslist was followed by a cross-country tour by Richardson and the Women's Funding Network.
None of the media that published Richardson's astonishing numbers bothered to examine the study at the heart of her claim. If they had, they would have found what we did after asking independent experts to examine the research: It's junk science.
After all, the numbers are all guesses.
The data are based merely on looking at photos on the Internet. There is no science.
Eric Grodsky, a sociologist at the University of Minnesota who teaches about proper research construction, says that the study is fundamentally flawed.
"The method's not clean," Grodsky says. "You couldn't get this kind of thing into a peer-reviewed journal. There are just too many unanswered questions about their methodology."
Ric Curtis, the chairman of the Anthropology Department at John Jay College of Criminal Justice in New York, led a Justice Department-funded study on juvenile prostitution in New York City in 2008. He's highly skeptical of the claims in the Women's Funding Network's study.
"I wouldn't trust those numbers," Curtis says. "This new study seems pretty bogus."
In fact, the group behind the study admits as much. It's now clear they used fake data to deceive the media and lie to Congress. And it was all done to score free publicity and a wealth of public funding.
"We pitch it the way we think you're going to read it and pick up on it," says Kaffie McCullough, the director of Atlanta-based anti-prostitution group A Future Not a Past. "If we give it to you with all the words and the stuff that is actually accurate—I mean, I've tried to do that with our PR firm, and they say, 'They won't read that much.'"
"A Future Not a Past" is a product of the Atlanta Women's Foundation, the Juvenile Justice Fund, and Harold and Kayrita Anderson's foundation. To measure the amount of juvenile prostitution in the state, the consortium hired the Schapiro Group, an Atlanta business-consulting operation.
The Schapiro Group members weren't academic researchers, and had no prior experience studying prostitution. In fact, the group was best known for research paid for by the American Chamber of Commerce Executives. The study found—surprise—that membership in the Chamber of Commerce improves a business's image.
The consultants came up with a novel, if not very scientific, method for tabulating juvenile prostitutes: They counted pictures of young-looking women on online classified sites.
"That's one of the first problems right there," Grodsky says. "These advertisers are in the business of making sales, and there's a market for young-looking women. Why would you trust that the photographs are accurate?"
In other words, the ads, like the covers of women's magazines, are relentlessly promoting fantasy. Anyone who has tried online dating understands the inherent trouble with trusting photographs.
Even if the person placing the advertisement is the one in the picture, there's no telling how old the photo is, says David Finkelhor, the director of the Crimes Against Children Research Center at the University of New Hampshire.
"How do you know when the pictures were taken?" Finkelhor asks. "It's not illegal for an 18-year-old who's selling sex to put up a picture of herself from when she was 16."
And if, for the sake of argument, the photos were an accurate portrayal, how do you train those viewing the photographs to guess the correct age?
In fact, you don't.
Before conducting its full study, the Schapiro Group tested the accuracy of its method in a sample of 100 observers. At one point, the 100 observers are described as a "random sample." Elsewhere, they are described as "balanced by race and gender."
These 100 adults were shown pictures of teenagers and young adults whose ages were known, and were asked to guess whether they were younger than 18.
"The study showed that any given 'young' looking girl who is selling sex has a 38 percent likelihood of being under age 18," reads a crucial passage in the explanation of methodology. "Put another way, for every 100 'young' looking girls selling sex, 38 are under 18 years of age. We would compute this by assigning a value of .38 to each of the 100 'young' girls we encounter, then summing the values together to achieve a reliable count."
This is dense gibberish posing as statistical analysis.When the team went on to conduct its full statewide study, it simply treated this 38 percent success rate as a constant. Six new observers were then turned loose to count "young-looking" sex ads on online classifieds sites like Craigslist and Backpage.
That total count was then multiplied by .38 to come up with a guesstimate of how many children were being trafficked.
"This is a logical fallacy," says Steve Doig, the Knight Chair in Journalism at Arizona State University, who reviewed the study at our request. "Consider this analogy: Imagine that 100 people were shown pictures of various automobiles and asked to identify the make, and that 38 percent of the time people misidentified Fords as Chevrolets. Using the Schapiro logic, this would mean that 38 percent of Fords on the street actually are Chevys."
But the Georgia sponsors were happy with the results—after all, the scary-sounding study agreed with what they were saying all along. So the Women's Funding Network paid Schapiro to dramatically expand the study to include Michigan, Minnesota, New York, and Texas. (Georgia's Kayrita Anderson sits on the board of the Women's Funding Network)
The Women's Funding Network says it would ultimately like to have the study running in all 50 states.
The count of online classifieds featuring "young women" is repeated every three months to track how the numbers change over time. That's the source of the claim of a 64 percent increase in child prostitution in Minnesota in a matter of months.
But that's not how a scientific study is supposed to work, says Finkelhor.
"They don't tell you what the confidence intervals are, so these changes could just be noise," he says. "When the Minnesota count goes from 102 to 112, that's probably just random fluctuations."
There's a more fundamental issue, of course.
"The trend analysis is simply a function of the number of images on these sites," Finkelhor says. "It's not necessarily an indication that there's an increase in the number of juveniles involved."
Despite these flaws, the Women's Funding Network, which held rallies across the nation, has been flogging the results relentlessly through national press releases and local member organizations. In press releases, the group goes so far as to compare its conjured-up data to actual hard numbers for other social ills.
"Monthly domestic sex trafficking in Minnesota is more pervasive than the state's annually reported incidents of teen girls who died by suicide, homicide, and car accidents (29 instances combined); infants who died from SIDS (6 instances); or women of all ages murdered in one year (37 instances)," reads the study.
Of course, those other figures are rigorously compiled medical and law-enforcement records of actual documented incidents, so it's not exactly an apples-to-apples comparison.
The police who tally many of those actual statistics—as well as records of real face-to-face encounters with juvenile prostitutes—don't seem to be very impressed by the statistics put forward by the Women's Funding Network.
"The methodology that they used doesn't really show the numbers that back it up," says Sgt. John Bandemer, who heads the Vick Human Trafficking Task Force in St. Paul. "We take it with a grain of salt."
The experts we consulted all agreed the Schapiro Group's published methodology raises more questions than it answers. So we went to the Schapiro Group to ask them.
Beth Schapiro founded the Schapiro Group in 1984, starting out mostly with political consulting. The bulk of the group's work, Schapiro says, consists of public opinion research. In 2007, the group installed its own phone-banking center, and the group's website advertises services ranging from customer satisfaction surveys to "voter persuasion calls."
Counting hard-to-find exploitation victims wasn't exactly in the company's repertoire when it was asked by A Future Not a Past to devise a study on juvenile prostitution in 2007, but Schapiro jumped at the opportunity.
The Georgia studies included efforts to count juvenile prostitutes on the street, at hotels, and in escort services, but they also marked the debut of the problematic online classifieds study that would later be reproduced in other states.
In a phone call this month, Schapiro insisted that her study was the first effort ever to try to scientifically determine the number of juvenile prostitutes—a claim that would likely surprise the authors of dozens of previous studies, several of which are footnoted in her own report.
When we asked Schapiro and Rusty Parker, the leader of the classifieds study, to fill in some of the missing pieces in their methodology, they had a hard time coming up with straight answers. In fact, Parker couldn't remember key information about how he constructed the study. When asked where he got the sample pictures used to calibrate the all-important 38 percent error rate, he wasn't sure.
"It was a while back," he says. "I forget exactly where we got them from."
Parker was equally fuzzy on how the researchers knew the ages of the people pictured in the control group."Um...I'm afraid I do not remember," he says.
You might say that this is important information. The Schapiro group has been telling the world that it cracked the alchemical code that transforms dumb guesses into hard statistics, and that the magic number is .38. But the leader of the study can't remember the procedure he followed to get that number.
Neither Schapiro nor Parker had any answers when asked if there was any empirical reason to believe their two critical assumptions: that online photos always represent what the prostitutes actually look like, and that the six handpicked observers conducting the state studies have exactly the same error rate as the initial test batch of 100 random citizens.
Instead, Schapiro beat a hasty retreat, saying the study results shouldn't be read as actual incidents of prostitution.
"We're the first to tell you, this is not a precise count of the number of girls being prostituted," Schapiro said. "We make no bones about that."
Of course, a precise count of the number of girls being prostituted is exactly what the statistics are being presented as in the media, in press releases, and in Schapiro's own study. When this is pointed out, Schapiro reverses herself.
"Well, yes, these are specific numbers," Schapiro backpedals. "And yes, they are hard numbers, and they are numbers that we stand completely behind."
This is the kind of cognitive whiplash you have to endure if you try to follow Schapiro down the rabbit hole. The numbers have the weight of fact and can properly be cited as actual incidents of juvenile prostitution, she insists. But when pressed to justify the broad and unsupported assumptions of her study, she says the study is just a work in progress and the numbers are only approximations.
Schapiro's grasp on empirical rigor is such that when asked point-blank to choose between her two contradictory interpretations—estimates or facts—she opts for "all of the above."
"I would square the circle by saying that you can look at them both ways," she says.
Any reporter who had read the methodology of the Schapiro report would have been left with doubts, and any reporter who followed up would probably have been treated to the same baffling circuit of non-answers. The fact that the study's findings continue to be rebroadcast in news outlets across the country suggests that not one reporter has bothered to read the study about which they are writing.
"You see this kind of thing a lot, unfortunately," says Rick Edmonds, a media business analyst for the Poynter Institute who writes frequently about statistics. "The kind of skepticism that reporters apply to a statement by a politician just doesn't get applied to studies."
David Finkelhor at the Crimes Against Children Research Center says he understands the pressure on reporters to cite figures when they're writing about juvenile prostitution, but it's something they need to resist, because despite what groups like the Women's Funding Network would have you believe, there simply are no good statistics.
"You have to say, 'We don't know. Estimates have been made, but none of them have a real scientific basis to them,'" Finkelhor says. "All you can say is, 'This is the number the police know about, and we think there are more than that, but we don't know how many more.'"
In her own online photos, the woman who commissioned the Schapiro Group study looks to be in her 50s, with blue eyes, graying hair, and a taste for dangly earrings.
Kaffie McCullough first approached the Schapiro Group about conducting a study of juvenile prostitution in Georgia in 2007 when, as director of A Future Not a Past, she realized that having scientific-sounding numbers makes all the difference in the world.
In early 2007, McCullough approached the Georgia Legislature to ask for money for a regional assessment center to track juvenile prostitution.
"We had no research, no nothing. The legislators didn't even know about it," she recalls. "We got a little bit. We got about 20 percent of what we asked for."
Later that year, the first Schapiro Group counts were made, and when McCullough returned to the Legislature the following session, she had the study's statistics in hand.
"When we went to the Legislature with those counts, it gave us traction—night and day," she says. "That year, we got all the rest of that money, plus we got a study commission."
McCullough touts the fundraising benefits of the study whenever she can. Since the Schapiro study was picked up for replication nationwide by the Women's Funding Network, McCullough has acted as a sort of technical consultant for state groups as they debate whether to invest money in the project. Whenever she's asked, McCullough tells the local groups that the money they spend will come back to them with hefty dividends.
"I would say, 'The research costs money, but we've been able to broker—I don't know what it is now, I think it's over $1.3, $1.6 million in funding that we never would have gotten,'" McCullough says.
McCullough initially maintained that she stands by the Schapiro Group study, in part because she has been told that "it is the same scientific methodology that science has been using for a long time to measure endangered species."
But when pressed on whether she really believes that counting Internet photos is reliable, she grants the sex-work industry isn't exactly the gold standard of truth in advertising. "That's absolutely correct," she says. "That's part of how that business operates: It's a bait-and-switch."
And given the tricky nature of the photographs, she admits that counting pictures isn't exactly a precise way to measure juvenile prostitutes.
"I can't guarantee that any picture that four of those six people said looked young—that may not be the girl that you'd get if you called up," she concedes.
Asked if she has any reason to believe that the six observers in the study have the identical 38 percent error rate as the 100 random citizens who were the initial test subjects, she allows that it might be worth revisiting that question.
The basic truth is that the study exists in service of the advocacy, and if news outlets present the Schapiro Group's numbers as gospel, it certainly doesn't hurt the advocates' cause.
Admitting that there isn't any authoritative scientific count of juvenile prostitution, as Finkelhor recommends, isn't an option in McCullough's book. She recalls an early presentation she made in Nebraska, when a politician gave her a piece of advice that stuck.
"He said, 'If you all as a movement don't start having numbers, you are going to lose the money,'" McCullough recalls. "'How can you justify millions of dollars when there are only hundreds of victims that you're actually serving?'"
After Nick's article came out, there were lots of "Comments," including this one, which was my favorite, by far:
From "Varmintito"...
I took a psychology course in high school, and one of the most fascinating topics was propaganda and persuasion. It identified a wide range of classic techniques, from ad hominem, to appeal to authority, to puffery.
No kidding, the test for that unit was to read a statement, identify the propaganda technique used, and explain why you thought so. This letter would have made excellent raw material. Let's recap:
Puffery: "carefully and meticulously conducting strategic research" "our legacy of solid, scientific studies performed by our highly talented team of applied social research experts" "providing policymakers, law enforcement, and social service agencies with important insights"
Ipse Dixit (literally "because I say so"): "pioneered empirical, replicable research methodologies" "a track record of developing innovative, common sense methodologies" "developed a series of logical assumptions upon which to base an admittedly conservative count" "Researchers at The Schapiro Group use methodological rigor" -- if so, why not identify your methodology, assumptions, etc. and explain why they are valid?
Assuming the point to be proven: "the formidable CSEC problem" "one of the most critical issues of our time" " this very serious issue"
Appeal to authority: "nationally recognized CSEC expert Michael Shively, PhD" "award-winning journalist Ann Woolner"
Straw man: "We encourage any reporter with questions about whether or not children are prostituted on Internet classifieds websites" -- the Voice disputed the claim that there is a huge amount of child trafficking, but did not dispute whether is ANY child trafficking.
Ad hominem: " Any doubts about his objectivity were confirmed by the overwhelmingly negative tone of the article. With an intent to trash, not explain, the research, it's not surprising that the article is replete with "bogus," "fake," "junk," and other words that reveal his true agenda." -- sorry, but the Voice reported actually discussed WHY your methodology is flawed, instead of simply attacking you. Moreover, the Voice isn't the only publication of observer that found your methodology wanting.
Bottom line: Ms. Schapiro does not explain, in any manner, why her company's methodology is sound. It is worth recalling, however, the essence of that methodology:
1. Assume that the woman portrayed in the escort ad is the actual person who will show up if you call. I bet the Schapiro Group's highly talented team of applied social science research expert had their minds blown when they saw the same stock photos in the escort ads in the Voice, Washington City Paper, Philly Weekly, Phoenix New Times, etc. "Hey Beth, you're not gonna believe this! Somewhere a woman gave birth to octuplets! Who all decided to run away to a different city! And all got trafficked! And all were forced to wear the same purple garter belt! And get the same hair style! And be photographed in the same pose! We need to tell the highly progressive Georgia House of Representatives about this right away!"
2. Assume that the woman portrayed in the escort ad did nothing to change her apparent age in any way (i.e., attempt to appear younger via makeup, HS cheeleader uniform, pigtails, etc.). Because it is a well-documented fact that the sale of high school cheerleader uniforms is carefully controlled, and only actual high school cheerleaders are allowed to own or even wear it. Consequently, it is an infallible indicator that the escort service uses only trafficked child prostitutes.
3. Assuming that the photograph of the woman in the escort ad is completely unretouched, because nobody in the porn business has ever heard of photoshop.
4. Looking at the women portrayed in escort ads, and guessing their age.
5. Because the woman portrayed in the escort ad is the actual person who will appear at your hotel room door if you call, this means that only one woman works for the escort service (unless more than one appears in the accompanying photograph). This means that the number of escorts is the same as the number of escort ads. Why, this means that there are at least 70 prostitutes in New York City! And according to our methodolgy, 27 +/- 3 look suspiciously young! It's a crisis! And what the hell is wrong with the parents of those octuplets?
6. Dammit Beth, the number needs to be higher. We are a big time outfit here. We profoundly influence how communities work and thrive. Our work puts on the front line of one of the most critical issues of our times. I don't care if the highly progressive Georgia House of Representatives wants reassurance that this is a minor issue! That's only because they are instinctively averse to bloviation and grandstanding! But we are not in the business of telling clients what they want to hear!
7. Let's see . . . take the number of hits to the Voice web site . . . multiply by the square root of the hypotenuse . . . round up to the nearest million . . . divide pi by four and give me the big piece. Mmmmmmm, strawberry rhubard, my favorite. What's that you say? A scoop of homemade ice cream on top? You read my mind! And mind reading is hard! Because it is magic! Which makes it harder than pioneering empirical, replicable research methodologies for studying the commercial sexual exploitation of children. Which means there are countless trafficked children living in Greenwich Village. Because counting makes my brain hurt.
8. I cannot emphasize enough that there is no proven methodology in this field, which proves that our methodology is empirical and replicable. Indeed, a person with a Ph.D. is quick to endorse "the inherent difficulties and the limitations of [our] method." Our guesswork is not ordinary guesswork, oh no no no no, it is educated guesswork because, like Michael Shively, I also have a Ph.D.
9. The Voice is wrong because they are pedophiles and not nearly so progressive as the Georgia House of Representatives. And Nick Pinto does not have a Ph.D. because he did not do his homework, or even call Michael Shively, who think's I'm the bee's knees and also has a Ph.D., even though we gave him the number, so neener neener.
10. In conclusion, children working for escort services in the United States is one of the most critical issues of our time, and I am on the front line.