Custom log parsing automation…

**xcntrk75** · 05-11-2005, 11:47 AM

Hey all, I’m wondering if anybody can help point me in the right direction with some custom log analysis and alarming I’m trying to put in place with my CarPC.

Here’s my situation, I have an engine management (EM) system which monitors my cars ECU and is interfaced with my CarPC. I connect to the EM system via hyperterminal and dump real-time log data to the screen. I would like to put some kind of software, script, API, something in place which will parse the log data and present an audible alarm (sound file) on a certain value, that value being knock (detonation).

My obstacles are;

Options for capturing the real-time log data as it’s presented to hyperterminal.
Parsing the log data for the given value (i.e. all 0’s until knock is detected then value is 1)
Executing a sound file when it occurs.

Anybody with some direction or general advice please respond. All comments appreciated…

Thanks…

**Maximus** · 05-11-2005, 12:05 PM

Leave out hyperterminal all together.
I assume it's serial communication between the EM and Hyperterminal, in which case you could write a small app in Visual Basic to capture the data and deal with the data any way you'd like.

Post a sample of the datastream that you get in hyperterminal and some pointers as to what they represent (unless that is obvious in the data itself) then it's a lot easier to tell how much work is ivolved.

I wrote a small app that I use with the wbO2 unit (same, or even better, as the Wide Band Commander and only at a third of the price).

/M

**xcntrk75** · 05-11-2005, 12:38 PM

Holy smokes that is an awesome setup!

An app like this would be the end-all solution to my objective. As a matter of fact, I’m sure if somebody built an interface such as this they would have a LARGE number of Subaru enthusiasts who use the EM system I’m referencing (UTEC) flocking to them with requests for the app.

Anyway, the EM system is accessed via simple serial communication and presents the following data values in real-time:

Code:

                    Load Knock                     Mod   Mod         Mod
RPM   MAP  MAF TPS Site Count  AFR  Ign#1  Inj#1  Ign   Fuel Boost  MAF
       psia  V   %                    deg   duty   deg    %   (CL)    V
1697  -9.4 1.4   0  00    00   rich +12.5    3.5 ECU.   +0.0 ECU.   1.5
1704 -11.2 1.5   0  00    00   16.1 +12.4    3.5 ECU.   +0.0 ECU.   1.3
1698 -11.8 1.3   0  00    00   23.7 +12.3    3.5 ECU.   +0.0 ECU.   1.5
1679 -12.0 1.4   0  00    00   24.2 +12.4    3.5 ECU.   +0.0 ECU.   1.4
1680 -11.8 2.0   9  00    00   24.2  +8.0   15.6 ECU.   +0.0 ECU.   2.5
1616  -9.1 2.3  46  10    00   21.6 +24.8    9.5 +33.9  +0.0 ECU.   2.3
1757  -6.1 2.2  98  10    00   rich +26.0   11.5 +32.6  +0.1 380.00 2.3
1846  -3.0 2.3  98  10    00   12.5 +26.9   11.8 +32.2  +0.1 400.00 2.4
1891  +0.0 2.4  98  10    00   12.9 +26.9   13.6 +31.8  +0.3 400.00 2.4
1948  +0.6 2.4  98  10    00   rich +27.9   13.8 +31.6  +0.3 400.00 2.4
1994  +1.1 2.5  97  10    00   12.3 +27.6   15.3 +31.0  +0.5 400.00 2.4
2058  +1.5 2.5  98  20    00   12.1 +26.9   14.3 +29.5  +0.5 400.00 2.5
2108  +1.9 2.6  97  20    00   13.2 +25.7   15.4 +28.0  +0.5 400.00 2.5
2171  +2.5 2.6  97  20    00   12.9 +24.6   16.1 +26.5  +0.5 400.00 2.6
2190  +2.9 2.6  98  20    00   13.1 +23.3   18.0 +25.5  +0.5 400.00 2.6
2266  +3.5 2.7  98  30    00   12.6 +21.8   18.5 +23.7  +1.4 400.00 2.7
2362  +3.9 2.7  97  30    00   12.3 +19.9   20.8 +22.5  +1.5 400.00 2.8
2443  +4.5 2.8  98  30    00   rich +18.0   22.0 +21.6  +1.5 400.00 2.9
2508  +4.9 2.9  97  30    00   12.1 +17.3   23.9 +21.0  +2.0 400.00 2.9
2594  +5.7 2.9  97  40    00   rich +15.8   26.0 +20.0  +2.1 400.00 3.0
2660  +6.6 3.0  97  40    00   rich +15.5   28.4 +20.0  +2.2 400.00 3.1
2732  +7.6 3.1  97  50    00   rich +14.3   33.0 +18.0  +3.2 400.00 3.2
2817  +9.0 3.2  97  60    00   rich +12.6   39.5 +16.0  +3.4 400.00 3.4
2921 +10.6 3.4  97  70    00   rich +12.2   46.0 +15.0  +3.7 400.00 3.5
3022 +12.5 3.4  97  80    00   rich +12.2   50.2 +14.0  +4.0 400.00 3.6
3162 +14.3 3.5  97  90    00   rich +12.1   52.2 +14.0  +3.5 400.00 3.6
3233 +15.7 3.5  97  90    00   rich +12.1   53.8 +14.0  +3.3 400.00 3.7
3363 +16.6 3.5  97  90    00   rich +11.8   54.7 +14.0  +2.5 400.00 3.7
3457 +16.8 3.7  97  90    00   rich +11.2   55.9 +14.0  +1.5 400.00 3.7
3557 +16.4 3.7  97  90    00   rich +10.8   58.4 +14.0  +1.1 400.00 3.8
3683 +16.6 3.7  97  90    00   rich +11.5   60.9 +14.0  +0.7 400.00 3.7
3779 +16.6 3.7  97  90    00   rich +12.1   63.4 +14.2  +0.4 400.00 3.8
3926 +16.4 3.8  97  90    00   rich +13.6   64.3 +15.0  +0.1 400.00 3.7
4006 +16.8 3.8  97  90    00   rich +14.6   68.0 +16.0  -0.1 400.00 3.8
4079 +16.6 3.8  97  90    00   rich +14.3   69.5 +16.5  -0.2 400.00 3.8
4182 +16.4 3.8  96  90    00   rich +14.3   69.5 +16.9  -0.3 400.00 3.8
4295 +16.6 3.8  97  90    00   rich +13.9   70.9 +17.0  -0.3 400.00 3.9
4450 +16.4 3.9  97  90    00   rich +13.4   78.9 +17.0  +0.3 400.00 4.0
4629 +16.1 4.0  97  90    00   rich +14.1   81.5 +17.6  +0.0 400.00 4.0
4649 +15.9 4.0  97  80    00   rich +14.8   82.1 +18.6  -0.3 400.00 4.0
4775 +16.1 4.0  97  90    00   rich +15.0   85.7 +18.8  -0.8 400.00 4.0
4844 +15.7 4.0  96  80    00   rich +15.4   85.7 +19.9  -1.3 400.00 4.0
5020 +15.7 4.0  97  80    00   rich +16.5   86.2 +22.0  -1.7 400.00 4.0
5012 +15.7 4.0  97  80    00   rich +18.1   89.3 +22.0  -1.7 400.00 4.0
5112 +14.9 4.1  97  80    00   rich +18.6   90.1 +22.0  -1.7 400.00 4.0
5274 +14.7 4.1  97  80    00   rich +19.5   94.5 +22.0  -1.8 400.00 4.0
5437 +14.3 4.1  96  80    00   rich +20.5   95.3 +22.0  -1.8 400.00 4.0
5455 +13.9 4.1  97  80    00   rich +21.1   95.5 +22.0  -1.9 400.00 4.0
5546 +14.3 4.1  97  80    00   rich +22.2   96.6 +22.0  -2.0 400.00 4.1
5592 +14.9 4.2  97  90    00   rich +22.4   96.5 +22.0  -2.2 400.00 4.1
5698 +14.5 4.2  97  80    00   rich +22.9   99.3 +23.0  -2.9 400.00 4.0
5797 +14.5 4.2  96  70    00   rich +23.4   95.4 +22.2  -2.8 400.00 4.0
5941 +13.7 4.2  96  70    00   rich +23.7   96.4 +23.0  -2.6 400.00 4.1
6006 +13.1 4.2  97  70    00   rich +23.4   96.3 +23.0  -2.9 400.00 4.0
6093 +12.9 4.2  97  70    00   rich +23.9   97.6 +23.0  -2.6 400.00 4.1
6071 +13.1 4.2  97  70    00   rich +23.6   97.9 +23.0  -2.9 400.00 4.1
6161 +13.1 4.2  97  70    00   rich +24.2   95.4 +23.0  -3.0 400.00 4.1
6253 +12.5 4.2  97  70    00   rich +26.4   97.4 +23.0  -3.0 400.00 4.1
6385 +12.7 4.2  97  70    00   rich +27.2   96.8 +23.0  -3.0 400.00 4.1
6410 +12.5 4.2  97  70    00   rich +27.1  ---.- +23.0  -3.0 400.00 4.1
6535 +12.1 4.3  97  60    00   rich +27.4  ---.- +24.0  -2.8 400.00 4.1
6680 +12.3 4.2  97  60    00   rich +28.3  ---.- +24.0  -2.8 LCM.   4.1
6265 +11.7 4.0  98  60    00   lean +29.4   77.5 +24.0  -2.8 LCM.   3.9
5464 +11.0 4.0  97  60    00   lean +23.4   73.6 +23.0  -1.8 400.00 3.8
4748 +12.3 4.0  97  70    00   rich +15.2   86.8 +18.6  -0.7 400.00 4.0
4734 +13.3 4.0  97  90    00   rich +14.9   86.9 +19.2  -0.8 400.00 4.0
4782 +15.3 4.0  96 100    00   rich +15.6   81.6 +19.8  -0.9 400.00 3.9
4816 +17.2 4.0  97 100    00   rich +15.8   85.4 +20.0  -1.1 400.00 4.0
4859 +17.6 4.0  97  90    00   rich +16.0   84.5 +20.0  -1.1 400.00 3.9
5112 +17.2 4.0  46  90    00   rich +22.1   82.8 +21.9  -1.6 180.00 3.0
5208 +11.3 3.6   0  00    00   13.6  +8.8   56.2 ECU.   +0.0 LCM.   3.4

This is the data presented by default. With a third party W/B hooked up you get an additional data column at the end of this stream with the associated value.

How much work do you think would be involved to write something similar to your app?

**Maximus** · 05-11-2005, 02:51 PM

Is that a straight capture from hyperterminal ?
No checksums no nothing ?

Do a "transfer >> capture text" and post the file.

Ah.. I found the manual:
http://www.turboxs.com/_images/UTEC/...nual%204.2.pdf

I guess what you posted is the logfile, but in that case, is it presented on the screen in realtime or only logged for later viewing ?
Worst case, you could probably use the dashboard feature, but that's probably very very slow by comparison to the logger.

Programming wise, if you just want to display that data stream in a similar way as I have, then it's not that much work.
If you want fancy dials, skinnability and so on... then it's a whole lot more.

/M

**xcntrk75** · 05-11-2005, 03:19 PM

That’s directly from the logging feature. When you launch the logger it dumps this info strait to your hyper-terminal, then this was captured with “capture text” feature. If you leave it running it simply continues to log this data to the screen indefinitely.

Would you be interested in sharing the VB source for your application to use as a reference, especially regarding the use of Win 32 APIs involved with serial communication?

I’m not much of a VB programmer but am very interested in getting a front-end like this…