Is it time to subscribe to a printer service from HP?

Ever since my dad brought home an...

What’s the best way of buying a phone today?

How did you buy your latest phone?...

MWC: What device highlights did you miss?

So, early last week I predicted that...

SpinVox latest response: 98% less messages are referred to humans

Update: The original title on this post was “SpinVox claims only 2% of messages are referred to humans”. As some have helpfully pointed out in the comments below, that is actually what’s being said in SpinVox’s latest release below. I was trapped by the clever PR spin. On with the rest of the post…

The company has been dragged kicking — and, I might venture, screaming (privately — into the limelight this week. Like the proverbial rabbit-in-the-headlights, this communications company completely forgot how to communicate with the outside world. A text-book case for the Crisis PR guidebook.

The press release they’ve issued today (on a Sunday, no less), was delivered to my email via their PR company, Porter Novelli. This release is the one that should have been sent out the moment the BBC picked up the story.

The fact that many knew that SpinVox was using legions of call centre agents (hundreds per market) to help in the transcription process was generally known or assumed by many in the technology industry. But the moment people were reminded that humans really *do* feature in the process, all sorts of privacy issues raised their ugly heads. Indeed, many were moved to wonder how much of SpinVox’s much-lauded technology was underpinned by humans.

For almost a whole week, the technology industry chattering classes — me included — wondered about this point. In my post on Friday night, I eventually asked ‘What percentage of SpinVox transactions require human assistance?

That was the real crux of the issue for me. If the company couldn’t answer that question, it was very, very bad news. The silence from SpinVox across the week spoke volumes to us.

Why didn’t SpinVox immediately publish figures? I mean — immediately?

What total idiot authorised the posting of a terse rebuttal press release on the company’s previously interactive, friendly blog?

Ridiculous.

After days of panic we have another statement.

Not published on the SpinVox blog though. I just had a look. No. True to this week’s strategy, SpinVox communications policy is all over the shop. I can’t link you to the press release so I’ll republish it here in full:

– – – – –

– “We’re in the last mile of solving the problem of reliable automatic speech conversion,” says Daniel Doulton.

– SpinVox Voice Message Conversion System (VMCSâ„¢) has become so advanced and efficient that it has reduced its use of QC agents by 98% in just two years.

– SpinVox VMCS contains two billion words and phrases and knows over 99 per cent of the words you are likely to say.

– Quality Control agents train VMCS to recognise new or difficult words and phrases.

London, UK – 26 July 2009.

SpinVox, the global leader in voice to content messaging, today took the opportunity to reveal some of the details about the technological breakthroughs it has achieved in the development of its Voice Message Conversion System (VMCSâ„¢).

VMCS system

The core technology around which the VMCS is built is unique to the speech market, so there is little to which it can be compared. It is based on world-leading breakthroughs in automatic speech recognition (ASR) combined with artificial intelligence, semantics and natural linguistics which have been developed by SpinVox Cambridge-based Advanced Speech Group (ASG).

VMCS already knows more than 99 per cent of anything a user is likely to say. It contains over two billion words and phrases derived from the equivalent of 72 years of audio training – making it the world’s largest corpus of spoken language. This knowledge system is growing at an ever-increasing rate and is further accelerating SpinVox ability to automate.

Dr Tony Robinson, a peer of Prof. Philip Woodland of the Cambridge University Machine Intelligence Laboratory, leads the SpinVox ASG of more than 20 speech specialists and PhDs who are working continually to develop and refine the system.

Professor Woodland explains: “Much of this technology derives from the world-leading research undertaken by my group at Cambridge University Machine Intelligence Laboratory. I am a consultant to SpinVox and its Automatic Speech Group and their unique approach allows the automatic system to be exposed to huge amounts of spoken data, from which highly accurate acoustic and language models can be built.”

This combined group of technologies and processes is the main engine for converting voice messages to text, rather than human intervention.

Having experimented with purely automatic speech conversion, SpinVox decided early on in its development that because its voice to text service converts real-life, dynamic and fast-evolving language and messages that we use and exchange every day (known in the industry as ‘free form speech’), it was essential that the system had the capability to evolve at the same rate, converting the latest words, phrases, brand names and colloquialisms to ensure a high level of accuracy. This is why it describes the system as ‘live-learning’.

SpinVox realised that only by combining its rapidly evolving state-of-the art technology with human quality control and training, could it create a system which could complete elements of messages which could not be automatically converted. As a result, the system constantly learns new words and phrases, making it increasingly efficient and reliable.

Explains SpinVox CIO Rob Wheatley: “Quality Control agents are an important part of the SpinVox service because their constant minute-by-minute input actually improves the quality of text conversions in a process we call `live learning`. The technology is a bit like a human brain, in that, the more it is exposed to input, the more it learns.

“This process has helped us improve our accuracy massively. Since its inception in 2007, the technology has improved to the extent that the system requires only two per cent of the input it required just two years ago and can even now predict more than 99 per cent of what most people speaking in English or Spanish will say next. Or to put it another way, in just two years, we have reduced the requirement for human intervention to just a few hundred agents per market compared to the thousands per market when we started. Our world-class speech scientists in the Advanced Speech Group have helped make this system unchallenged in terms of accuracy, speed and reliability.”

Privacy

As discussed above, SpinVox VMCS learns from human intervention. This is the reason SpinVox works with five, world-class, call centres which have been chosen after SpinVox put around 50 call centres through its stringent quality control and security procedures.

Every message is dealt with initially by the automated system. Only in cases where speech is too indistinct to be dealt with by the system, or contains unfamiliar or new words or phrases, is the completely anonymised and encrypted message sent to a QC agent for help. The agents will only ever see the messages that need input and do not know how many other messages have been converted, processed and sent automatically by VMCS.

SpinVox is fully compliant with industry standards relating to the processing of information, including the Data Protection Act 1998. To this end, any part of a message seen by the Quality Control centres is anonymous, encrypted and randomised, meaning that it is impossible to determine where the messages are from or where they are going to. SpinVox has achieved two prestigious ISO qualifications: ISO 27001 (the international Information Security Standard) and ISO 9001:2008 quality certification.

Jaime Tronqued is President of ScopeWorks Asia, Inc., a Quality Control house which handles private and secure customer services for companies in telecommunications, travel, banking, healthcare and insurance.

ScopeWorks has been working with SpinVox for the past two years and Tronqued says: “I can categorically assure people that SpinVox messages are both private and secure. There are many layers of security and privacy that are used to ensure this and SpinVox was extremely thorough in its audit of our operations, our security and our privacy procedures as they ran a training pilot with our Quality Control agents on test conversion messages, prior to contracting with us to deliver a live customer service using encrypted and anonymised messages. “

Adds Ragindra Persaud, CEO of NPIC, a South American-based Quality Control house, which has also been working with SpinVox for the past two years. “SpinVox went through a thorough review of our processes and procedures, and it was not until they were fully satisfied that we comply with their stringent requirements, that they contracted with us officially. In the live customer system there is no way for any Quality Control agent to know where a message has come from or to whom it is being sent, nor copy or abuse this.”

SpinVox – now and in the future

SpinVox has achieved enormous success in the past and intends to achieve even greater success in the future. It currently has 30 million users worldwide and will be converting voice to text services for over 100 million users by the end of 2009. It is a British success story based on breakthroughs in technology that have established a new class of automated speech conversion.

Says co-founder Christina Domecq: “We have spent five years working very hard, building up a solid foundation for this business. It’s something of which we are very proud, whether it’s our technology, our customer group, subscriber base or investors. Like every business, we have to deal with challenges, particularly in the middle of a credit crunch, but we are in a strong position, are growing fast and are looking to the future with confidence. We are a business that is founded on a long-term vision and for that reason we do everything by the book, which includes a very thorough approach to security and due diligence.”

Adds co-founder Daniel Doulton: “We knew when we started SpinVox that the time was right for this kind of breakthrough. We had to take this innovative approach, because leading commercial speech technology at the time was unable to deliver a reliable experience. We’ve developed our own, data-driven system which works on a ‘meaning’ (i.e. semantic) basis to solve the automation problem. To help achieve this, we have recruited the best speech scientists from Cambridge and abroad to build a team of more than 20 speech specialists and PhDs. Now, SpinVox is leading the market, having created a whole new category of ‘speech as a service’. We’ve already signed 28 operators in the two short years we’ve been selling to carriers, and there are more deals to come.”

Explains Julie Meyer, CEO, Ariadne Capital, an early investor in SpinVox: “The company’s genius is how it integrates its technology with human intelligence, which is still the only thing that machines can learn from, to do virtually real-time voice-to-text conversion.

“SpinVox has built up huge value in terms of its intellectual property, customer relationships, management and revenue growth. Because they don’t sell through UK mobile operators people tend to forget just how successful they are continuing to be in the rest of the world. To close a deal in the past few months with Telefonica, for instance, and subsequently roll-out the service to 13 countries across Latin America is an amazing feat that we in the UK should feel proud of.”

– – – – –

My position? Well, I have an answer to my question. 2% of voicemails are read by humans. I know quite a few folk who won’t react well to that statistic, who’ll believe it’s not entirely accurate.

But me? I don’t know. I don’t know whether to believe the statistic. I don’t know because my interaction model with the company is completely nailed. I’d have used the personal reputation of the deliverer of the statement to help infer accuracy. For example, if I’d received this from SpinVox’s social media man, James Whatley, on the back of copious briefing/update phone calls, texts and IM chats with him across last week, I think I’d have taken the response at face value. I’d have evaluated *all* my interactions with James over the years and known that his personal reputation is far too valuable to him to spin — and I’d have used this release to close the book on the issue.

But James is somewhere in Montana or somewhere out of contact. The official SpinVox Twitter feed is — like their blog — a ghost town and nobody I know from SpinVox has been in touch.

What to do, what to think?

The goodwill I bore the company has evapourated. I don’t really know what to think. The total silence — apart from the terse statement — completely surprised me leading me to wonder what the hell was going on with the company this week.

I was a massive fan. Absolutely massive. Do a search for ‘spinvox’ here on Mobile Industry Review to read my continual blessings.

I think my expectations were entirely surprised — my brand loyalty, rather shaken. Time to move on.

56 COMMENTS

  1. Ewan, I can’t see in that statement where you get that 2% figure from….

    Can you elaborate please?

  2. OK:

    “the system requires only two per cent of the input it required just two years ago”

    That’s not the same as “only 2% of messages are referred to humans”

    Sorry to be a pedant, but there are lies, damned lies and statistics!!

  3. Is it actually saying 2% of messages are referred though?

    “Since its inception in 2007, the technology has improved to the extent that the system requires only two per cent of the input it required just two years ago” – that's certainly 2% of something, but I'm not sure what. There are a lot of different numbers and stats in that their statement but it feels like there's a bit of smoke and a few mirrors left.

  4. The problem with this Ewan, as you rightly allude to, is that it is hard to believe after such a long silence (and in the social media world – one which SpinVox claimed to be playing in – this has been a veeerrrrry long silence).

    If this was the case, why not just say it earlier and get on with it. In fact if this stat is true, why not have said it a long time ago and prevent the BBC story from ever being a story. To my mind, 98% is a pretty powerful stat and part of the reason why I just accepted that humans did a lot of it was because I can only imagine how hard it is to decipher a strange accent talking in a noisy atmosphere, saying ‘in-jokes’ that only the recipient understands. So why the such a long silence?

    It seems that a very poor [almost non-existent] understanding of PR has created this problem for SpinVox and then watched it grow to the extent that it is likely to bring the company down.

  5. Actually, after reading the release again, they still don’t actually state how many messages are done by computers or humans, or a bit of both. What they state is they need 98% less human interaction – which isn’t quite the same as 2% of messages done by humans.

    So, even after all this, they’re trying to hide behind ‘clever’ PR.

    Why can’t they just be up front and honest?

  6. Just to make it clear, I'm not blaming Porter Novelli the agency. I can't imagine that any agency would suggest this kind of strategy. It seems to me to be a cultural fear or misunderstanding of PR at SpinVox.

  7. Hold on a mo, still think you;re being spun here

    ” the system requires only two per cent of the input it required just two years ago “

    Let's be evil. Let's try and work out how many MESSAGES this is. ie how BIG can the number be. First up, lets say at the start ALL messages had to go to humans. 100%. So that means now tha tthe input required is two percent of the workload. Okay, imagining a sample of 1000 SMS messages,each filling 160 characters. That's 160,000 letters, so taking an average of 5 letters per word (good rule of thumb in code breaking) that's 32,000 words

    So in year X, 32,000 of 32,000 words are checked by humans.

    Now, in year X+2, 32000/50 only 640 words need checked. But how many messages does that represent? Well if the 160 SMS long messages contain, on average 32 words, then our batch of 1000 messages with an equal spread has one wrong word in two thirds of the messages, and that means we could be lookign at an upper limit of 66% of messages requiring human intervention.

    That's a far cry from the PR spin attempt at 2%

    …and I'm not even a statistician!

  8. Read everything from SpinVox carefully – without the context they are working from you cannot make any assumption about what the figures actually mean. For instance being able to predict 99% of the time what is going to be said does not mean it has been listened to, the system may predict, but it needs to be verified. Also it might predict 99% of the content but also predicts another million combination's of words and phrases – only a person could work out from all the possible predictions what is the correct one.

  9. Read everything from SpinVox carefully – without the context they are working from you cannot make any assumption about what the figures actually mean. For instance being able to predict 99% of the time what is going to be said does not mean that it has not been listened to – the system may predict, but it needs to be verified. Also it might predict 99% of the content but also predicts another million combination of words and phrases – only a person could work out from all the possible predictions what is the correct one.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Recently Published

Is it time to subscribe to a printer service from HP?

Ever since my dad brought home an HP LaserJet printer (version 3, if memory serves), I have been printing with an HP. Over the...

What’s the best way of buying a phone today?

How did you buy your latest phone? I'm asking because I'm thinking about what I should be doing. When I was living in Oman, I...

MWC: What device highlights did you miss?

So, early last week I predicted that next to nothing from Mobile World Congress would break through into the mainstream media. I was right,...

How Wireless Will Pave the Path to Neobank Profitability

I'm delighted to bring you an opinion piece from Rafa Plantier at Gigs.com. I think it's particularly relevant given the recent eSIM news from...

An end of an era: Vodafone UK turns off 3G services

I thought it was worthwhile highlighting this one from the Vodafone UK team. For so long - for what feels like years, seeing the...

Mobile World Congress: Did the mainstream media notice?

I resolved this year to make sure I wrote something - anything - about Mobile World Congress, the huge mobile industry trade show taking...