Importing raw datalogs into megatune as files. Possible?

[pems]

Hi

Say one would have a standalone datalogger, which will record on an SD card all the data that megasquirt normally just dumps onto the serial port during normal datalogging.
Is there a way in megatune to simply open such a raw datalog file and import the data (converting it into the proper XLS datalog file) or is one stuck to be diddling around with virtual serial ports and the burst mode to get the raw datalog into megatune?

If no such feature exists, can the megatune developers PLEASE add this? I imagine it is very trivial to add (basically, just stream the raw datalog data from an open file handle as opposed to serial port handle, and skip sending the 'A''s)
This will make it that much easier to devise a standalone datalogger for the megasquirt platform.

If the motivation is an issue here, would this kind of request from a number of members of this community sway it to the positive side?

Cheers and happy holidays

[LT401Vette]

There are a couple of these type devices in prototype around the board. I'm just waiting for one of them to reach the point they can provide a log file, then I'm planning to build this capability into TunerStudio or possibly directly into MegaLogViewer.

[max78]

I have also a prototype and have the same problem with converting raw data to a XLS datalog.
It's a lot of work to write a program which uses the config file to convert the raw stream to a XLS datalog.
And most of this is implemented in Megatune, the only problem is that this only works from the serial interface and not from a file.

My prototype board is working. It saves the datastream on a SD-card (Fat readable on the PC). But only in Raw format.
I use an ATMega32 controller.

[LT401Vette]

Do you have a file already? Is it just back to back binary och commands?

As you assessed, it isn't terribly difficult for the tuning apps to convert these from a file. There are a couple aspects that should be settled for file format though. Straight raw binary och data back to back has a couple of problems.
- No error checking. The tuning software can not tell what firmware or settings the file was captured under. If a user gets it wrong, the log would be a mess. In the current ini's most settings only impact view data, like deg C or F. The underlying data in the och is the same. But there are a couple of rather important ones that go beyond that... Like RpmHiRes in MS1 Extra. It actually has references back to the tune or constants, so if you don't have an msq loaded you can not reproduce that field.

- Time field. This is usually created by the tuning software as the records come in. I see 2 potential ways to generate the time field, look at the secL value and divide it across the records with the same secL. So this would assume a consistent delta Time between record pulls.
Alternatively a time stamp could be added by the hardware. This would give a more accurate Time field.


So again this isn't very hard to do, but at a minimum we need to get the signature in the input file.
Then I'm thinking the Tuning App will need to require a Project and configuration (msq) be loaded. If we can come up with what will be in the file, I'll generate a sample file and put this in the Feb release of TunerStudio.

[max78]

I have a file. I logged from a MS2extra. (I think it was version MS2/Extra 2.0.1 RELEASE)
It writes the data from the Uart direkt to a SD-Card (binary) and I used 23456789 for separating the datastreams (but I can change this).
I can select how many bytes the controller collects. It's not the best solution, but it works.

[max78]

Are there any news?
Should I change something in my file?
With my logger the data will be binary.
But I can write a header (signature), separating bytes, maybe a time...

[LT401Vette]

I have built a raw data converter in for another person working on a logger to the format we worked out. If you have a format in mind, email me at p_tobin<at>yahoo.com

[65looter]

Hi Phil,

Is this data converter available for download?

I have built a raw data converter in for another person working on a logger to the format we worked out. If you have a format in mind, email me at p_tobin<at>yahoo.com

[LT401Vette]

Actually, you probably already have it

It is built straight into TunerStudio, in earlier version is was hidden by default, but in the current version 0.988.9 you can get to it right from the menu:
Data Logging --> "Import Conversion / Conversion" --> "Convert Binary Log (FRD / SD)"

You do need to have a project open that matched the signature in the frd file. Just as TunerStudio needs a project open with a matching ini to understand and communicate over the serial line, it also needs the same to import binary data.

[65looter]

thanks a lot