July 22, 2024 • 18 mins
With tens of millions of users under the age of 13, Roblox has become the biggest online gaming playground for kids. The company says its combination of AI chat filters and human moderators makes the platform safe for users of all ages. But a Bloomberg Businessweek investigation suggests that Roblox may have striking vulnerabilities.
On today’s Big Take podcast, host David Gura speaks with reporters Olivia Carville and Cecilia D’Anastasio about the way predators have used the platform to groom children — and what Roblox is doing to keep young users safe.
See omnystudio.com/listener for privacy information.
Mark as Played
Transcript
Episode Transcript
Available transcripts are automatically generated. Complete accuracy is not guaranteed.
Speaker 1 (00:03):
Bloomberg Audio Studios, podcasts, radio news.
Speaker 2 (00:11):
Roadblocks is one of the largest online gaming platforms in
the world, and Cecilia Donistasio, who covers video games for Bloomberg,
explain to me how it works.
Speaker 1 (00:21):
Think of it as a mall of video games, and
there are all of these little enclaves in there, but
it doesn't charge admission to get into the mall, and
you don't have to pay to get into any of
the enclaves.
Speaker 2 (00:32):
And like the mall I remember from my childhood, Roadblocks
is a place a lot of kids go to to
hang out. Worlds and characters on the platform look like
a crossover between the Lego movie and Minecraft. Blocky, three
dimensional and often colorful, and the platform has millions of
user made games.
Speaker 1 (00:52):
There are games in Roadblocks where you pretend you're working
at a pizza parlor, or where you fling yourself down
a set of stairs repeatedly, or you raise a virtualorns,
and they're all very weird and whimsical and the kind
of games that really appeal the kids.
Speaker 3 (01:05):
When I started looking at Roadblocks, I was blown away
by how popular it is.
Speaker 2 (01:10):
That's Bloomberg investigative reporter Olivia Carville. She says more than
seventy seven million people sign onto Roadblocks every day, and
more than forty percent of them are under the age
of thirteen.
Speaker 3 (01:24):
This is where kids are today. Roadblocks welcomes children, It
invites kids of all ages. You can create an account
as a three year old, a four year old, a
five year old and play on this platform, and that
really surprised me.
Speaker 2 (01:37):
One thing that makes it so popular is it's really
easy to access.
Speaker 1 (01:42):
It's really quite simple, and that's why kids download it
and play it across iPhone, iPad, android, PC, PlayStation, any
device you can think of. It's free there.
Speaker 2 (01:52):
Signing up is simple. Cecilia says it takes about sixty seconds.
You put in your birth date, pick a username, and
to pass, and you can customize an avatar. Everyone on
Roadblocks is anonymous, and once you're online, you can interact
with other players and you can chat with them.
Speaker 1 (02:10):
A lot of the trust and safety individuals that we
spoke to for the story said that Roadblocks's open chat
was one of its most dangerous features. You can create account,
you can talk to anyone, anyone can talk to you.
Speaker 2 (02:22):
Roadblocks uses a combination of human moderators and AI and
says it's safe for kids of all ages, but as
Olivia and Cecilia discovered that anonymity can be exploited and
it's left some young users vulnerable. Today on the show,
a Bloomberg Business Week investigation into how sexual predators have
(02:45):
infiltrated the world's biggest online playground and the ongoing fight
to keep users safe. This is the big take from
Bloomberg News. I'm David Durray. Before we get to the
rest of the day day's show, I want to let
you know that we're going to talk about some tough subjects,
including child abuse. Roadblocks was launched in two thousand and six,
(03:10):
and while it grew steadily, Cecilia Donastasio says it's popularity
spiked during the pandemic when kids were stuck at home.
Speaker 1 (03:18):
Roadblocks just blossomed into this virtual cul de sac. And
you know, when it went public in twenty twenty one,
it had a forty one billion dollar valuation.
Speaker 2 (03:28):
Today it has a market cap of about twenty five
billion dollars and one way the company makes money is
through a virtual currency you can purchase on the platform
called roebucks.
Speaker 1 (03:39):
Kids buy this currency, kids beg for this currency, from
their parents. It's huge. Roadblocks made three point five billion
dollars last year, primarily through the sale of roebucks.
Speaker 2 (03:50):
Users on Roadblocks can spend that currency on virtual accessories
like wings, hats or costumes that make their avatars look
like a cockroach or like Peter Griffin from the show
Family Guy. Establish brands like Nike and Gucci sell virtual
goods on the platform, but it's independent developers who make
most of the items and games on Roadblocks. Cecilia says
(04:13):
that in the world of Roadblocks, a game developer can
have a huge following.
Speaker 1 (04:18):
Roadblocks developers are like modern day god kings on digital platforms,
and that sounds like an exaggeration, but there are so
many that have become so popular that they've had to
completely anonymize themselves, lockdown any even iota of some existence
outside of an avatar and a username on Roadblocks because
(04:39):
kids are ravenous for information about these people who are
cultivating spaces where they forge their identities, they make connections,
they grow up.
Speaker 2 (04:52):
One of those developers who became wildly popular called himself
doctor Rafatnik. That's a not so subtle nod to the
villain in in the Sega game Sonic the Hedgehog. Olivia
Carville says doctor Rafatnik created what is basically a Sonic
knockoff called Sonic Eclipse Online through Siga.
Speaker 3 (05:10):
You have to pay for the game. Here on roadblocks,
you've got access to it for free. And he knew
that kids love Sonic, so he created the space and
thousands of children came and played Sonic Eclipse Online.
Speaker 2 (05:22):
And as his game became more and more popular, so
did Doctor Rafatnik himself. Cecilia and Olivia told me his
signature avatar would wander around the world he'd built, soaking
up the adulation.
Speaker 1 (05:34):
On roadblocks. He was just wearing a tall white hat
and a red tie and an American flag pin. And
he looked a debonair professional, even political.
Speaker 3 (05:46):
He said he was an industry visionary, that he was braggadocius.
He claimed that he was twenty eight years old, that
he lived in California, that he was the younger brother
of John Sheidlitski, who was the platform's first creative designer,
who was an absolute legion and among children.
Speaker 2 (06:02):
Doc as he came to be known, also told users
that he had a quote hot Spanish girlfriend, that he
drove a fast car, and he'd encourage roadblocks users who'd
chat with him to take those conversations with him to
other online platforms.
Speaker 1 (06:17):
You can click on a Discord link or an x link,
and your relationship all of a sudden, is cross platform,
and there it can blossom soon.
Speaker 2 (06:24):
Doc was multi platform famous.
Speaker 3 (06:27):
So he created in an online kingdom where children could
look up to him, interact with him, talk to him regularly.
Some of them said he was online twenty four seven.
Anytime you reached out to him, he'd reply.
Speaker 2 (06:39):
And what a lot of his followers found appealing about Doc,
Olivia says, was his dark and edgy humor, but also
that he'd pay them in robucks. That's what was he
paying them for? What was he asking them to do
for that virtual currency.
Speaker 3 (06:52):
He actually had dozens of kids working for him. They
also would design new characters for him or new spaces
inside the game, and he'd pay them for that.
Speaker 2 (07:01):
Doc also encouraged bullying. Olivia says he used racist and
homophobic slurs, and in twenty twenty, a group of teen
vigilantes on roadblocks decided they'd had enough. Just heads up
what they sounded the alarm one could be troubling to hear.
Speaker 3 (07:18):
These gamers go after doctor Rofetnak, and what they do
is they post screenshots of a conversation he had with
a young twelve year old girl who worked for him,
where he talked about kidnapping her, raping her. He had
very inappropriate, hyper sexualized conversations with her, and all of
those screenshots were uploaded into a document that they dropped
(07:40):
on Twitter.
Speaker 2 (07:40):
One of those gamers took that document to the police,
but that went nowhere. But eventually the mother of that
twelve year old girl saw those messages and she contacted
Roadblocks herself.
Speaker 3 (07:52):
Her mum files a report to Roadblocks and explains that,
you know, there's a really creepy, dangerous man, a developer
going after her child and asked the platform for help.
So Roadblocks did receive a number of complaints from users
about the doctor Offetnek account, and four days after being
notified of these messages that he had been exchanging with
(08:16):
these young users, they blocked his account. They shut him down.
Speaker 2 (08:20):
But that wasn't the end of it.
Speaker 3 (08:21):
It was kind of just the beginning.
Speaker 2 (08:25):
We'll be right back. Roadblocks blocked doctor Rafatnick's account, but
the man behind it was able to stay active on
the platform, He simply made another account before his main
account was banned. Doc transferred ownership of his game Sonic
Eclipse Online to a friend who kept running it on
(08:45):
his behalf. Roadblocks left it active because they said the
game itself didn't pose any safety concerns and told Bloomberg
It continued to search for and ban any of Doc's
alternate accounts. So kids kept playing the game and Doc developed,
They kept paying him through their in game purchases, and
they continued to look up to him. One of them
(09:07):
was a teenage girl from Indiana.
Speaker 3 (09:09):
In May of twenty twenty two, a fifteen year old
girl goes missing. Her mom comes home and sees that
all of her electronics have gone from her bedroom. Her
favorite blanket's gone, some of her clothing is gone, her
charges are gone, and she sees that she's posted a
photo onto Instagram which shows her sitting inside a stranger's
(09:30):
car looking out the window, and she just wrote goodbye.
Speaker 2 (09:33):
Indiana law enforcement started to investigate what they assumed was
a child abduction case, and a detective asked the girl's
family who she'd been talking to online.
Speaker 3 (09:45):
She started to hear about this mystery figure who said
he was a popular developer on this gaming platform Roadblocks,
that he lived in California. She liked to draw, and
he actually called the mum at one point and told
her that he wanted to buy this teenage girl's artwork.
After that, Amazon packages started arriving on the doorstep, and
(10:09):
the girl would receive different tools or technology to help
with her artwork. She received a Teddy Beer takeout food
McDonald's Chinese noodles would come again.
Speaker 2 (10:20):
That's according to the detective's account of her conversation with
the victim's family. The police got a hold of the
girl's private communications on social media, and they found she
and a man had exchanged hundreds of sexualized messages. The
FBI took over the case, and agents traced those Amazon
packages to an address in New Jersey.
Speaker 3 (10:41):
Six unmarked cars pulled into the street for the stakeout
of this house, and within minutes, the teenage victim rounded
the corner with Arnold Castillo.
Speaker 2 (10:52):
Arnold Castillo, aka doctor Rafatnik, had groomed the girl in
the virtual world of Roadblocks and then abused her in
the real world, where he was not A twenty eight
year old brother of a famous game designer in California.
He was a lonely twenty two year old man whose mom,
according to prosecutors, pulled him out of school in the
seventh grade and told him to make money through developing
(11:15):
video games. He still lived with her in a small
apartment above a garage. Castillo put his victim in a
room he'd rented in a building next door.
Speaker 3 (11:24):
The prosecutor described the room that she was kept in
as this teeny, tiny, dank, damp room where he'd thrown
a twin mattress on the floor. He brought her hi
Adai to change her appearance.
Speaker 2 (11:38):
Olivia says she and Bloomberg Gaming reporter Cecilia Denistasio managed
to determine and Roadblocks confirmed that Castillo was active on
Roadblocks on the day of his arrest. He was using
a different username than doctor Rafatnik, but he was active
on the platform all the same. He pleaded guilty to
transportation of a miner with intent to engage in criminal
(11:58):
sexual activity, coercion and enticement of a minor, and Castillo
is now serving a fifteen year prison sentence. Police across
the US have arrested at least two dozen people since
twenty eighteen who have abducted or abused victims they met
on roadblocks. That's according to data compiled by Bloomberg BusinessWeek.
Olivia and Cecilia reached out to Roadblocks for comment.
Speaker 3 (12:23):
We received a statement from Roadblocks's Chief safety Officer, Matt Kaufman,
and he said that safety and civility are foundational to Roadblocks,
and they said that tens of millions of people of
all ages have a safe and positive experience on roadblocks
every single day.
Speaker 1 (12:39):
Kaufman also rejected the claim that child engagement is widespread
or a systemic problem on roadblocks. He says that the
company has strong systems and protocols that are designed to
catch anyone circumventing their rules, including attempts to move conversations
off roadblocks for users who are under thirteen.
Speaker 2 (12:58):
But Olivia and Cecily say that current and former employees
they spoke with told them that before twenty twenty two,
Roadblocks didn't have automated systems in place to proactively search
for grooming behavior beyond basic text filters. According to their sources,
back then, the word grooming didn't even appear in the
company's moderation guide. Roadblocks has made some changes since Arnold
(13:21):
Castillo is arrested. The company has two new child safety
investigators and a child exploitation moderation team. There's a child
safety officer who reports to Roadblocks's CEO, and on July fifteenth,
after multiple inquiries from Bloomberg Business Week, Roadblocks announced it
would change its default settings after this fall. Users under
(13:42):
the age of nine will be automatically restricted to games
that feature nothing more unsettling than mild violence and unrealistic blood.
Parents will have the option to allow their children to
access more mature content. But the scale of this problem
is only just coming into focus. In twenty twenty two,
Roadblocks reported nearly three thousand incidents of child exploitation to
(14:05):
the National Center for Missing and Exploited Children. In twenty
twenty three, it flagged more than thirteen thousand. What really
worries child safety experts is Roadblocks's ambition. It's a publicly
traded company that's trying to get even bigger, and to
do that, it's aiming to have one billion users every day.
(14:27):
So you've spoken with a lot of I guess past
and present employees of the company. What do they say
about the challenge of scaling up the company of that
size and also scaling up the safety side of things
in tandem.
Speaker 1 (14:39):
It would be very difficult to find a platform out
there where safety and growth were not at odds, and
Roadblocks is one of those platforms. Sources I spoke with
at the company said that artificial intelligence isn't really capable
of picking up on the subtle signs of grooming.
Speaker 2 (14:54):
Eight current and former trust in safety workers told Bloomberg
Business Week that user growth at Roadblocks takes prior over
child safety. They described calls for more resources going unanswered,
resulting in a backlog of safety incident reports. A Roadblock
spokesperson disputed the claims about resources and backlogs and says
the company has a robust pipeline of safety features in development.
(15:18):
Roadblock says that every second, fifty thousand chat messages are
sent on the platform, but it's not just the volume
that makes Roadblocks hard to police.
Speaker 1 (15:27):
How do you tell if an avatar is simulating sex?
How do you tell if an avatar is simulating rape?
These are enormous challenges and ones that Roadblocks I think
has not necessarily grappled with.
Speaker 2 (15:41):
You've talked to online safety experts, what is the advice
that they give to parents whose kids are in this
virtual world and to kids themselves who are trying to
navigate this at a very young age.
Speaker 1 (15:54):
The question of child safety on all of these platforms
is what can parents do? What can parents do? How
can parents, you know, get into their kids' devices and
ensure that they're safe and not? What defaults must there be,
What age getting measures must there be, what chat filters
must exist, what moderation protocols, what number of moderations should
(16:15):
be employed by these companies? And I think part of
the issue is that there isn't the kind of literacy
with these platforms that's necessary for parents to really advocate
to them and to really make specific asks, or to
ask politicians to make really specific asks. I'm not a
parent myself, so maybe I'm speaking out of turn when sure,
they can disable a lot of settings, but you know,
(16:38):
we exist in a market where growth is why platforms desire,
and safety is at odds with that, and there just
aren't a lot of laws or policies that are forcing
companies to adopt common sense measures that will protect children.
That's something that safety experts have repeated over and over
and over to us.
Speaker 3 (16:58):
So much of this conversation has been so dark and
so depressing. And while we don't want to deflect responsibility
onto parents, Roadblocks should be doing more to keep its
platform safer. They even say that themselves. They're continually working
to improve their safety measures.
Speaker 2 (17:14):
But there are.
Speaker 3 (17:15):
Things that parents can be doing that they should know about.
You know, there are safety features in the app. If
you do some research, you can switch on these safety settings.
They're not turned on by default, but you can go
in and do that for your child. Talk to them
openly about their experiences in the game, allow them to
come to you, to have those conversations. And I think that,
(17:38):
you know, parents should be proactively looking at what their
kids are doing because unfortunately the platforms just aren't doing
enough right now.
Speaker 2 (17:50):
This is the big take from Bloomberg News. I'm David Gera.
This episode was produced by David Fox with help from
RFA Jalasho Perry. It was edited by Aaron Edwards and
Robert Friedman. It was fact checked by Adriana Tapia and
mixed by Alex Sagura. Our senior producers are Kim Gittleson
and Naomi Shaven, and our senior editor is Elizabeth Ponso.
(18:10):
Nicole Beamster Boor is our executive producer. Sage Bauman is
Bloomberg's head of podcasts. Thanks so much for listening. Please
follow and review The Big Take wherever you get your podcasts.
It helps new listeners find the show. We'll be back tomorrow.
Bloomberg Audio Studios, podcasts, radio news.
Speaker 2 (00:11):
Roadblocks is one of the largest online gaming platforms in
the world, and Cecilia Donistasio, who covers video games for Bloomberg,
explain to me how it works.
Speaker 1 (00:21):
Think of it as a mall of video games, and
there are all of these little enclaves in there, but
it doesn't charge admission to get into the mall, and
you don't have to pay to get into any of
the enclaves.
Speaker 2 (00:32):
And like the mall I remember from my childhood, Roadblocks
is a place a lot of kids go to to
hang out. Worlds and characters on the platform look like
a crossover between the Lego movie and Minecraft. Blocky, three
dimensional and often colorful, and the platform has millions of
user made games.
Speaker 1 (00:52):
There are games in Roadblocks where you pretend you're working
at a pizza parlor, or where you fling yourself down
a set of stairs repeatedly, or you raise a virtualorns,
and they're all very weird and whimsical and the kind
of games that really appeal the kids.
Speaker 3 (01:05):
When I started looking at Roadblocks, I was blown away
by how popular it is.
Speaker 2 (01:10):
That's Bloomberg investigative reporter Olivia Carville. She says more than
seventy seven million people sign onto Roadblocks every day, and
more than forty percent of them are under the age
of thirteen.
Speaker 3 (01:24):
This is where kids are today. Roadblocks welcomes children, It
invites kids of all ages. You can create an account
as a three year old, a four year old, a
five year old and play on this platform, and that
really surprised me.
Speaker 2 (01:37):
One thing that makes it so popular is it's really
easy to access.
Speaker 1 (01:42):
It's really quite simple, and that's why kids download it
and play it across iPhone, iPad, android, PC, PlayStation, any
device you can think of. It's free there.
Speaker 2 (01:52):
Signing up is simple. Cecilia says it takes about sixty seconds.
You put in your birth date, pick a username, and
to pass, and you can customize an avatar. Everyone on
Roadblocks is anonymous, and once you're online, you can interact
with other players and you can chat with them.
Speaker 1 (02:10):
A lot of the trust and safety individuals that we
spoke to for the story said that Roadblocks's open chat
was one of its most dangerous features. You can create account,
you can talk to anyone, anyone can talk to you.
Speaker 2 (02:22):
Roadblocks uses a combination of human moderators and AI and
says it's safe for kids of all ages, but as
Olivia and Cecilia discovered that anonymity can be exploited and
it's left some young users vulnerable. Today on the show,
a Bloomberg Business Week investigation into how sexual predators have
(02:45):
infiltrated the world's biggest online playground and the ongoing fight
to keep users safe. This is the big take from
Bloomberg News. I'm David Durray. Before we get to the
rest of the day day's show, I want to let
you know that we're going to talk about some tough subjects,
including child abuse. Roadblocks was launched in two thousand and six,
(03:10):
and while it grew steadily, Cecilia Donastasio says it's popularity
spiked during the pandemic when kids were stuck at home.
Speaker 1 (03:18):
Roadblocks just blossomed into this virtual cul de sac. And
you know, when it went public in twenty twenty one,
it had a forty one billion dollar valuation.
Speaker 2 (03:28):
Today it has a market cap of about twenty five
billion dollars and one way the company makes money is
through a virtual currency you can purchase on the platform
called roebucks.
Speaker 1 (03:39):
Kids buy this currency, kids beg for this currency, from
their parents. It's huge. Roadblocks made three point five billion
dollars last year, primarily through the sale of roebucks.
Speaker 2 (03:50):
Users on Roadblocks can spend that currency on virtual accessories
like wings, hats or costumes that make their avatars look
like a cockroach or like Peter Griffin from the show
Family Guy. Establish brands like Nike and Gucci sell virtual
goods on the platform, but it's independent developers who make
most of the items and games on Roadblocks. Cecilia says
(04:13):
that in the world of Roadblocks, a game developer can
have a huge following.
Speaker 1 (04:18):
Roadblocks developers are like modern day god kings on digital platforms,
and that sounds like an exaggeration, but there are so
many that have become so popular that they've had to
completely anonymize themselves, lockdown any even iota of some existence
outside of an avatar and a username on Roadblocks because
(04:39):
kids are ravenous for information about these people who are
cultivating spaces where they forge their identities, they make connections,
they grow up.
Speaker 2 (04:52):
One of those developers who became wildly popular called himself
doctor Rafatnik. That's a not so subtle nod to the
villain in in the Sega game Sonic the Hedgehog. Olivia
Carville says doctor Rafatnik created what is basically a Sonic
knockoff called Sonic Eclipse Online through Siga.
Speaker 3 (05:10):
You have to pay for the game. Here on roadblocks,
you've got access to it for free. And he knew
that kids love Sonic, so he created the space and
thousands of children came and played Sonic Eclipse Online.
Speaker 2 (05:22):
And as his game became more and more popular, so
did Doctor Rafatnik himself. Cecilia and Olivia told me his
signature avatar would wander around the world he'd built, soaking
up the adulation.
Speaker 1 (05:34):
On roadblocks. He was just wearing a tall white hat
and a red tie and an American flag pin. And
he looked a debonair professional, even political.
Speaker 3 (05:46):
He said he was an industry visionary, that he was braggadocius.
He claimed that he was twenty eight years old, that
he lived in California, that he was the younger brother
of John Sheidlitski, who was the platform's first creative designer,
who was an absolute legion and among children.
Speaker 2 (06:02):
Doc as he came to be known, also told users
that he had a quote hot Spanish girlfriend, that he
drove a fast car, and he'd encourage roadblocks users who'd
chat with him to take those conversations with him to
other online platforms.
Speaker 1 (06:17):
You can click on a Discord link or an x link,
and your relationship all of a sudden, is cross platform,
and there it can blossom soon.
Speaker 2 (06:24):
Doc was multi platform famous.
Speaker 3 (06:27):
So he created in an online kingdom where children could
look up to him, interact with him, talk to him regularly.
Some of them said he was online twenty four seven.
Anytime you reached out to him, he'd reply.
Speaker 2 (06:39):
And what a lot of his followers found appealing about Doc,
Olivia says, was his dark and edgy humor, but also
that he'd pay them in robucks. That's what was he
paying them for? What was he asking them to do
for that virtual currency.
Speaker 3 (06:52):
He actually had dozens of kids working for him. They
also would design new characters for him or new spaces
inside the game, and he'd pay them for that.
Speaker 2 (07:01):
Doc also encouraged bullying. Olivia says he used racist and
homophobic slurs, and in twenty twenty, a group of teen
vigilantes on roadblocks decided they'd had enough. Just heads up
what they sounded the alarm one could be troubling to hear.
Speaker 3 (07:18):
These gamers go after doctor Rofetnak, and what they do
is they post screenshots of a conversation he had with
a young twelve year old girl who worked for him,
where he talked about kidnapping her, raping her. He had
very inappropriate, hyper sexualized conversations with her, and all of
those screenshots were uploaded into a document that they dropped
(07:40):
on Twitter.
Speaker 2 (07:40):
One of those gamers took that document to the police,
but that went nowhere. But eventually the mother of that
twelve year old girl saw those messages and she contacted
Roadblocks herself.
Speaker 3 (07:52):
Her mum files a report to Roadblocks and explains that,
you know, there's a really creepy, dangerous man, a developer
going after her child and asked the platform for help.
So Roadblocks did receive a number of complaints from users
about the doctor Offetnek account, and four days after being
notified of these messages that he had been exchanging with
(08:16):
these young users, they blocked his account. They shut him down.
Speaker 2 (08:20):
But that wasn't the end of it.
Speaker 3 (08:21):
It was kind of just the beginning.
Speaker 2 (08:25):
We'll be right back. Roadblocks blocked doctor Rafatnick's account, but
the man behind it was able to stay active on
the platform, He simply made another account before his main
account was banned. Doc transferred ownership of his game Sonic
Eclipse Online to a friend who kept running it on
(08:45):
his behalf. Roadblocks left it active because they said the
game itself didn't pose any safety concerns and told Bloomberg
It continued to search for and ban any of Doc's
alternate accounts. So kids kept playing the game and Doc developed,
They kept paying him through their in game purchases, and
they continued to look up to him. One of them
(09:07):
was a teenage girl from Indiana.
Speaker 3 (09:09):
In May of twenty twenty two, a fifteen year old
girl goes missing. Her mom comes home and sees that
all of her electronics have gone from her bedroom. Her
favorite blanket's gone, some of her clothing is gone, her
charges are gone, and she sees that she's posted a
photo onto Instagram which shows her sitting inside a stranger's
(09:30):
car looking out the window, and she just wrote goodbye.
Speaker 2 (09:33):
Indiana law enforcement started to investigate what they assumed was
a child abduction case, and a detective asked the girl's
family who she'd been talking to online.
Speaker 3 (09:45):
She started to hear about this mystery figure who said
he was a popular developer on this gaming platform Roadblocks,
that he lived in California. She liked to draw, and
he actually called the mum at one point and told
her that he wanted to buy this teenage girl's artwork.
After that, Amazon packages started arriving on the doorstep, and
(10:09):
the girl would receive different tools or technology to help
with her artwork. She received a Teddy Beer takeout food
McDonald's Chinese noodles would come again.
Speaker 2 (10:20):
That's according to the detective's account of her conversation with
the victim's family. The police got a hold of the
girl's private communications on social media, and they found she
and a man had exchanged hundreds of sexualized messages. The
FBI took over the case, and agents traced those Amazon
packages to an address in New Jersey.
Speaker 3 (10:41):
Six unmarked cars pulled into the street for the stakeout
of this house, and within minutes, the teenage victim rounded
the corner with Arnold Castillo.
Speaker 2 (10:52):
Arnold Castillo, aka doctor Rafatnik, had groomed the girl in
the virtual world of Roadblocks and then abused her in
the real world, where he was not A twenty eight
year old brother of a famous game designer in California.
He was a lonely twenty two year old man whose mom,
according to prosecutors, pulled him out of school in the
seventh grade and told him to make money through developing
(11:15):
video games. He still lived with her in a small
apartment above a garage. Castillo put his victim in a
room he'd rented in a building next door.
Speaker 3 (11:24):
The prosecutor described the room that she was kept in
as this teeny, tiny, dank, damp room where he'd thrown
a twin mattress on the floor. He brought her hi
Adai to change her appearance.
Speaker 2 (11:38):
Olivia says she and Bloomberg Gaming reporter Cecilia Denistasio managed
to determine and Roadblocks confirmed that Castillo was active on
Roadblocks on the day of his arrest. He was using
a different username than doctor Rafatnik, but he was active
on the platform all the same. He pleaded guilty to
transportation of a miner with intent to engage in criminal
(11:58):
sexual activity, coercion and enticement of a minor, and Castillo
is now serving a fifteen year prison sentence. Police across
the US have arrested at least two dozen people since
twenty eighteen who have abducted or abused victims they met
on roadblocks. That's according to data compiled by Bloomberg BusinessWeek.
Olivia and Cecilia reached out to Roadblocks for comment.
Speaker 3 (12:23):
We received a statement from Roadblocks's Chief safety Officer, Matt Kaufman,
and he said that safety and civility are foundational to Roadblocks,
and they said that tens of millions of people of
all ages have a safe and positive experience on roadblocks
every single day.
Speaker 1 (12:39):
Kaufman also rejected the claim that child engagement is widespread
or a systemic problem on roadblocks. He says that the
company has strong systems and protocols that are designed to
catch anyone circumventing their rules, including attempts to move conversations
off roadblocks for users who are under thirteen.
Speaker 2 (12:58):
But Olivia and Cecily say that current and former employees
they spoke with told them that before twenty twenty two,
Roadblocks didn't have automated systems in place to proactively search
for grooming behavior beyond basic text filters. According to their sources,
back then, the word grooming didn't even appear in the
company's moderation guide. Roadblocks has made some changes since Arnold
(13:21):
Castillo is arrested. The company has two new child safety
investigators and a child exploitation moderation team. There's a child
safety officer who reports to Roadblocks's CEO, and on July fifteenth,
after multiple inquiries from Bloomberg Business Week, Roadblocks announced it
would change its default settings after this fall. Users under
(13:42):
the age of nine will be automatically restricted to games
that feature nothing more unsettling than mild violence and unrealistic blood.
Parents will have the option to allow their children to
access more mature content. But the scale of this problem
is only just coming into focus. In twenty twenty two,
Roadblocks reported nearly three thousand incidents of child exploitation to
(14:05):
the National Center for Missing and Exploited Children. In twenty
twenty three, it flagged more than thirteen thousand. What really
worries child safety experts is Roadblocks's ambition. It's a publicly
traded company that's trying to get even bigger, and to
do that, it's aiming to have one billion users every day.
(14:27):
So you've spoken with a lot of I guess past
and present employees of the company. What do they say
about the challenge of scaling up the company of that
size and also scaling up the safety side of things
in tandem.
Speaker 1 (14:39):
It would be very difficult to find a platform out
there where safety and growth were not at odds, and
Roadblocks is one of those platforms. Sources I spoke with
at the company said that artificial intelligence isn't really capable
of picking up on the subtle signs of grooming.
Speaker 2 (14:54):
Eight current and former trust in safety workers told Bloomberg
Business Week that user growth at Roadblocks takes prior over
child safety. They described calls for more resources going unanswered,
resulting in a backlog of safety incident reports. A Roadblock
spokesperson disputed the claims about resources and backlogs and says
the company has a robust pipeline of safety features in development.
(15:18):
Roadblock says that every second, fifty thousand chat messages are
sent on the platform, but it's not just the volume
that makes Roadblocks hard to police.
Speaker 1 (15:27):
How do you tell if an avatar is simulating sex?
How do you tell if an avatar is simulating rape?
These are enormous challenges and ones that Roadblocks I think
has not necessarily grappled with.
Speaker 2 (15:41):
You've talked to online safety experts, what is the advice
that they give to parents whose kids are in this
virtual world and to kids themselves who are trying to
navigate this at a very young age.
Speaker 1 (15:54):
The question of child safety on all of these platforms
is what can parents do? What can parents do? How
can parents, you know, get into their kids' devices and
ensure that they're safe and not? What defaults must there be,
What age getting measures must there be, what chat filters
must exist, what moderation protocols, what number of moderations should
(16:15):
be employed by these companies? And I think part of
the issue is that there isn't the kind of literacy
with these platforms that's necessary for parents to really advocate
to them and to really make specific asks, or to
ask politicians to make really specific asks. I'm not a
parent myself, so maybe I'm speaking out of turn when sure,
they can disable a lot of settings, but you know,
(16:38):
we exist in a market where growth is why platforms desire,
and safety is at odds with that, and there just
aren't a lot of laws or policies that are forcing
companies to adopt common sense measures that will protect children.
That's something that safety experts have repeated over and over
and over to us.
Speaker 3 (16:58):
So much of this conversation has been so dark and
so depressing. And while we don't want to deflect responsibility
onto parents, Roadblocks should be doing more to keep its
platform safer. They even say that themselves. They're continually working
to improve their safety measures.
Speaker 2 (17:14):
But there are.
Speaker 3 (17:15):
Things that parents can be doing that they should know about.
You know, there are safety features in the app. If
you do some research, you can switch on these safety settings.
They're not turned on by default, but you can go
in and do that for your child. Talk to them
openly about their experiences in the game, allow them to
come to you, to have those conversations. And I think that,
(17:38):
you know, parents should be proactively looking at what their
kids are doing because unfortunately the platforms just aren't doing
enough right now.
Speaker 2 (17:50):
This is the big take from Bloomberg News. I'm David Gera.
This episode was produced by David Fox with help from
RFA Jalasho Perry. It was edited by Aaron Edwards and
Robert Friedman. It was fact checked by Adriana Tapia and
mixed by Alex Sagura. Our senior producers are Kim Gittleson
and Naomi Shaven, and our senior editor is Elizabeth Ponso.
(18:10):
Nicole Beamster Boor is our executive producer. Sage Bauman is
Bloomberg's head of podcasts. Thanks so much for listening. Please
follow and review The Big Take wherever you get your podcasts.
It helps new listeners find the show. We'll be back tomorrow.
Hosts And Creators
Sarah Holder
Saleha Mohsin
Popular Podcasts
40s and Free Agents: NFL Draft Season
Daniel Jeremiah of Move the Sticks and Gregg Rosenthal of NFL Daily join forces to break down every team's needs this offseason.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
The Bobby Bones Show
Listen to 'The Bobby Bones Show' by downloading the daily full replay.