Voice recognition using SAPI

**djScript** · 09-20-2004, 01:45 PM

I'm creating a new thread so I won't clutter 0l33l's "Voice activated navigation for routis!" thread.

I wrote my own voice recognition app using SAPI. It's generic and can be used in any application that accepts keyboard input. Features and the grammar XML can be found on my website: http://galant.circledplus.com/carpc/carpc_apps_vr.html I'll create a download link later tonight in case somebody's interested to try it out.

I have a few questions for NTurkey...

Is it possible to create adhoc attributes? Like task manager I'm getting an error if I create an attribute it doesn't recognize. This is the reason why I just used the inner PROPNAME in the example below.

Code:

  <RULE NAME="runApp" ID="RID_RunApp" TOPLEVEL="ACTIVE">
    <P>open</P>
    <L PROPNAME="runAppvalue">
      <P PROPNAME="task manager" VALSTR="taskmgr.exe">task manager</P>
      <P PROPNAME="i Guidance" VALSTR="iGuidance">navigation</P>
      <P PROPNAME="Media Car" VALSTR="C:\Program Files\MediaCar\MEDIACAR.exe">media car</P>
    </L>
    <O>...</O>
  </RULE>

Also, is there a way to get the text at a particular node? Like I want to get "task manager" (between the P tags, not the PROPNAME) from the above code.

TIA

**BeamRider** · 09-20-2004, 04:37 PM

Want to try

What language?
:edit: What programming language?

**Danceheaven** · 09-20-2004, 05:49 PM

Originally Posted by BeamRider

Want to try

What language?
:edit: What programming language?

VB.Net

**NTurkey** · 09-20-2004, 07:53 PM

Originally Posted by djScript

I have a few questions for NTurkey...

Is it possible to create adhoc attributes? Like task manager I'm getting an error if I create an attribute it doesn't recognize.

As far as an arbitrary attribute for the P element in SAPI's XML, no, you can't create arbitrary XML attributes. The SAPI compiler will complain.

In your example above, are you just trying to keep track of the application name, as well? If so, you could use something like this (you'll find two properties in the result, instead of just one ... one called AppToLaunch and one called AppName):

Code:

   <RULE NAME="GlobalApps" TOPLEVEL="ACTIVE">
      <L>
         <P PROPNAME="AppToLaunch" VALSTR="taskmgr.exe">
            <P PROPNAME="AppName" VALSTR="Task Manager">
               Task Manager
            </P>
         </P>
         <P PROPNAME="AppToLaunch" VALSTR="C:\Program Files\MediaCar\MEDIACAR.exe">
            <P PROPNAME="AppName" VALSTR="Media Car">
               Media Car
            </P>
         </P>
      </L>            
   </RULE>

Originally Posted by djScript

Also, is there a way to get the text at a particular node? Like I want to get "task manager" (between the P tags, not the PROPNAME) from the above code.

What language are you using? If you're using C++, you can get the ISpPhrase interface from the result, then you can call GetText.

To determine what the appropriate start and count would be, once you have the SPPHRASEPROPERTY, you can look at ulFirstElement and ulCountOfElements. You might have to change your grammar around a little bit, but not much.

Does that make any sense? I bet it doesn't if you're not using C++.

**djScript** · 09-21-2004, 12:37 AM

Originally Posted by NTurkey

In your example above, are you just trying to keep track of the application name, as well?

Yes, which is basically the same as the command that's why I wanted to get the text between the tags. GetText(FirstElement, NumberOfElements) seems to have did the trick and I didn't have to change the grammar

.

Originally Posted by NTurkey

What language are you using?

I'm using VB.net

Thanks.

**djScript** · 09-21-2004, 12:44 AM

The app can be downloaded from my website:
http://galant.circledplus.com/carpc/carpc_apps_vr.html

Just post here if you need help in grammar configuration.

**rgardjr** · 09-21-2004, 06:13 PM

Download link on website doesn't work for me.

Also, I'm moving this reply over to here from other thread:

Originally Posted by djScript

I wrote a voice recognition app that can be fully customized through the xml file. I'm using this app to voicecommand mediacar by enabling winamp's global hotkeys. Even if mediacar is not the active window, I could still control the audio section.

Check it out on my website --> http://galant.circledplus.com/carpc/carpc_apps.html

Let me know if you're interested and I'll create a new thread. I don't want to hijack 0l33l's thread.

Looks good. I saw that you're using MediaCar and thought I'd mention an idea I had for navigating between the audio, navigation, dvd, ect... portions since it didn't appear to me that keystrokes were supported. I just wrote tiny programs that send a single mouse click to the button of the area I want to navigate to. I'm sure somebody could write a program that would take a skin file and parse the information into lines ready to be coded into a program. Once again nice job!

**djScript** · 09-21-2004, 09:48 PM

Originally Posted by rgardjr

Download link on website doesn't work for me.

Does it give you any error? 404? I tested it and it worked for me.

Try this:
VoiceRecognition

Let me know if that still won't work and I'll just attach the file here.

Originally Posted by rgardjr

Looks good. I saw that you're using MediaCar and thought I'd mention an idea I had for navigating between the audio, navigation, dvd, ect... portions since it didn't appear to me that keystrokes were supported. I just wrote tiny programs that send a single mouse click to the button of the area I want to navigate to. I'm sure somebody could write a program that would take a skin file and parse the information into lines ready to be coded into a program. Once again nice job!

I updated the grammar and created a new rule to support sending mouse clicks. It will switch to the application window you want to control first before it moves the mouse and sends a click. I have some few commands for MediaCar's main menu buttons.

**rgardjr** · 09-21-2004, 11:12 PM

Originally Posted by djScript

Does it give you any error? 404? I tested it and it worked for me.

Try this:
VoiceRecognition

Let me know if that still won't work and I'll just attach the file here.

The above link worked great.

Originally Posted by djScript

I updated the grammar and created a new rule to support sending mouse clicks. It will switch to the application window you want to control first before it moves the mouse and sends a click. I have some few commands for MediaCar's main menu buttons.

Wow! This is great news. Can't wait to get this in my car. What microphone are you using in your car and how good of job does it do?

**djScript** · 09-22-2004, 09:08 AM

Originally Posted by rgardjr

Wow! This is great news. Can't wait to get this in my car. What microphone are you using in your car and how good of job does it do?

I'm using a regular cheap-o mic

:

I have to speak a bit louder if my windows are down or music is playing. But I can deal with that. I have a sony remote on the streering wheel column, so I hit the pause button first before I activate voiceRecognition.