Welcome to the iMore Forums Create Your Account or Ask a Question Answers in 5 minutes - no registration required!
Results 1 to 5 of 5
  1. Thread AuthorThread Author   #1  
    somerussianguy's Avatar
    iPhone Nanite

    Posts
    2 Posts
    Global Posts
    92 Global Posts

    Post Android voice-assistant comparison

    I posted this on Android Central, thought I'd share it with the iOS crowd. Just to give you some idea of how well (and not so well) our own voice-assistants work.

    A couple of months ago I did a detailed comparison on my blog between 3 apps. I used the same phrases to see how well each app handles the inquiry. Since the original post is pretty long, and iMore only allows 10k words in a post, I'll post just a few inquiries here.

    I'd love to hear any kind of feedback.

    Original at:

    Apps used: AIVC, Assistant, Dragon Go, Evi, Google Voice Actions, iris, Jeannie, S-Voice (port), Skyvi, Vlingo


    "Who was the first/twelfth/twenty-first president of united states?"


    AIVC
    Understood the first question perfectly and gave me a pretty detailed answer in less than two seconds. I'm impressed! Second question it misunderstood "was" for "is" and provided me with an irrelevant smartass answer. Take two, another smartass answer. Third question, resulted in another useless response. I'm not impressed anymore...

    Assistant
    Understood me perfectly and responded with "let's check Google". If I wanted to Google it, I would've simply Google'd it! It messed up on the last question, however, second attempt got me the correct result (in Google search).

    Dragon Go
    Dragon Go understood me perfectly and all questions were answered correctly.

    Evi
    First question It took its time searching to ultimately give me a link with the wrong answer. For the second question it again took it's time, but at least it provided me with a link to the correct answer. Final question was misunderstood as it searched for "...president of unite beach". Take two, again it gave me a link. Might as well just Google it!

    Google
    First question went into search and it replaced the "was" with "is" and the top result was wrong. Second and third questions went into search as well but at least the top results had the answer.

    iris
    Took a few seconds on the first question, but gave me the same answer as AIVC. Second question was much quicker and fairly detailed as well. It had trouble understanding "president" on the third question, but gave me a good answer on second try.

    Jeannie
    First question it misunderstood me. I did four takes on the first question where the app did actually understand the question, however, it did not search. Or do anything actually. It just froze with the question on the bottom. Second question did actually provide me with an answer. Third question gave me the answer but was a little out of syntax.

    S-Voice
    Well it gave me the answer but was slow! Second question, again understood me perfectly, gave me an answer, and did it slower than anything out there. Third question, same results.

    Skyvi
    First question, understood what I said perfectly and gave me an irrelevant answer: "John F. Kennedy was the first president of Roman Catholic faith..." That's not what I asked! For the second question, shockingly, it actually gave me a proper answer. A proper result for the last question as well. On questions 2 and 3, I actually got the result in less than two seconds!

    Vlingo
    Vlingo gave me proper results for all three questions and did it fast - two seconds tops.

    Conclusion
    Vlingo is the obvious winner here. It understood me perfectly this time and found the answers faster than the other apps.


    "Who is the tallest person in the world / how tall is the tallest person in the world?"


    AIVC
    It understood the question but responded with "Sometimes I don't know a client's real name so I make one up based on their DNS. The whole world?" ...Take two, same exact response! Second question got me another cute response: "Let me guess. 2 meters? The whole world?" Guess?! Let me guess the status of this app after I'm done writing this post, it will be deleted, never to be used again?

    Assistant
    Google search again, useless!

    Dragon Go
    Same as before, it understood the question and provided a more-detailed answer (the overall record tallest person and his height and current tallest person and his height).

    Evi
    It finally gave me a straight answer! And in just a second! Second question was much slower to give the answer but I got it nonetheless.

    Google
    It understood the question but searched for it in the browser with no apparent answer in the end.

    iris
    Gave me the answer to the first question pretty fast (about 3-4 seconds), and gave me a pretty detailed answer. A very basic answer to the second question.

    Jeannie
    Gave me a pretty detailed answer in a few seconds. About the same for the second question.

    S-Voice
    For the first question I got "I didn't catch that. Please try again". Take two: I got some radio frequency...I really don't know how to explain that. Last take I finally got the answer! Second question got me an answer right away.

    Skyvi
    The first question got me a response of "a list of tallest people in the world, living or dead". Except, there was no actual list! Only that incomplete response. Second question, same exact answer.

    Vlingo
    First question gave me the name in less than two seconds. Second question gave me the answer just as fast. They're both seem to be correct (Sultan Kösen at 8'1").

    Conclusion
    Jeannie was the best all around. Fast and detailed answers.


    "Set alarm for 8 am/o' clock"


    AIVC
    First time with "8am" resulted in an error. "8 o' clock" brought up a friendly time interface. Clicking "set" brings you to the standard alarm interface where you can actually confirm the alarm. Bottom line, it works.

    Assistant
    Doesn't understand the "o clock" part but does pretty well with AM/PM. Gives you a confirmation menu after your command.

    Dragon Go
    No alarm functionality.

    Evi
    No alarm functionality.

    Google
    "Set an alarm for 8 o' clock" gave me a menu to choose either AM or PM. If you say AM or PM instead, you can set it right away by pressing Set.

    iris
    Using "8am" works well. Brings up a basic set alarm menu then brings you into the standard Android alarm menu. Saying "8 o'clock" however, gets you a response of "What is your real name?" What the hell does this have to do with an alarm?!

    Jeannie
    Both 8am and 8 o'clock work and unlike other apps it does not bring up its own alarm menu, but rather asks for a confirmation. Then it takes you to the standard Android alarm menu.

    S-Voice
    Understands both am and o'clock. Confirmation is through a voice command instead of a menu. It could not actually save though.

    Skyvi
    It understands both 8am and 8 o'clock but asks for a location... Why the hell does it need a location for an alarm?!

    Vlingo
    First two times it understood what I said but it went to a browser search for "set alarm for 8:00". Third time it searched for "call long 488". Not funny, Vlingo!

    Conclusion
    Even though setting an alarm is supposed to be a function of Vlingo, it simply refused to work. And S-Voice crapped out on this one, probably because it's a port. This one goes to Jeannie.


    "Update Facebook: I'm testing out some voice apps; so far they are not that useful. Update Twitter: these voice apps are useless"


    AIVC
    This one did not quite understand the actual Facebook message. There's no Twitter updating, at least not on the free version of the app.

    Assistant
    After the Facebook sign-in, this thing automatically posts something along the lines of "I like my new assistant, it's very cool". I didn't ask it to post that! Thankfully you can say no before it actually posts it. After that it actually works pretty well, although voice recognition was a little off with a couple of words. Should be the same story for Twitter, except it didn't actually post anything.

    Dragon Go
    You can sign-in to Facebook and Twitter in Dragon Go as well. Too bad it doesn't actually do s***! You can search for people on Facebook or Twitter, that's about it.

    Evi
    You can sign-in to Facebook but just like Dragon Go, it doesn't do anything.

    Google
    I get....nothing! I can't update Facebook even though I have the official app.

    iris
    Facebook updating works fairly straight forward. Twitter works as well. Voice recognition was off with both of them.

    Jeannie
    This is supposed to be a feature of Jeannie but it simply refused to work with Facebook. It understands the command but nothing happens. Saying "update twitter" brings up Google Drive... I really don't know how to explain that.

    S-Voice
    Well I got an error on this one when I had the Facebook app installed. Otherwise after the sign-in it works as it should. Also, it uses Vlingo to update your Facebook status. Twitter had no trouble. Updating works well on S-Voice.

    Skyvi
    Updating Facebook does so without confirmation. It simply updates it. Although, voice recognition was off. Twitter is supposed to work with Skyvi but I just could not sign-in.

    Vlingo
    Vlingo got this one right when I tested it with Facebook. Voice-recognition worked well as it recognized most words, and I had no issues updating the status. Twitter updated no problem but the voice recognition was a little off.

    Conclusion
    S-Voice and Vlingo are the only ones that had no trouble signing in or actually updating the status on both Facebook and Twitter. Even though both had trouble understanding the message.

    There are more examples in my original post! Direct link to the post: Appreciate any feedback.
  2. #2  
    pkcable's Avatar
    iMore Specialist

    Posts
    1,457 Posts
    Global Posts
    30,813 Global Posts
    iOS Version
    iOS 5.1.1

    Default

    Might be interesting to compare these to Siri also.
  3. Thread AuthorThread Author   #3  
    somerussianguy's Avatar
    iPhone Nanite

    Posts
    2 Posts
    Global Posts
    92 Global Posts

    Default

    Quote Originally Posted by pkcable View Post
    Might be interesting to compare these to Siri also.
    Yeah, I'll definitely update the original post with Siri, when I actually find somebody who can lend me their iPhone for a while...

    Side note: I can't post direct links?
  4. #4  
    pkcable's Avatar
    iMore Specialist

    Posts
    1,457 Posts
    Global Posts
    30,813 Global Posts
    iOS Version
    iOS 5.1.1

    Default

    Don't look at me I'm a BlackBerry guy! And for the record I'm a loyal Vlingo user for many years. As for the links, you can probably do them at 10 post at least that's how it works at CrackBerry.com where I am a Mod.
  5. #5  
    kch50428's Avatar

    Posts
    10,213 Posts
    Global Posts
    11,091 Global Posts
    iOS Version
    7.0

    Default

    Quote Originally Posted by somerussianguy View Post
    Side note: I can't post direct links?
    Not until you get your post count up.
    Keith - iMore Moderator - The Mobile Nations/iMore Forum Rules
     iPhone5 on VZW;  iPad(2012) - wifi with BadElf for GPS
    "When the debate is lost, slander becomes the tool of the loser." -- Socrates

Tags for this Thread

Posting Permissions

B