SD logs sometimes getting truncated?

Testing and development of Megasquirt 3

Moderators: jsmcortina, muythaibxr

Post Reply
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

SD logs sometimes getting truncated?

Post by elaw »

Is anyone else having an issue with SD logs intermittently getting truncated with the pre-1.5.1 beta 3 firmware?

This does not happen to me all the time, but based on a spot check I'd say at least half of my logs are truncated, on trips that are way too short to fill up the log file (I think).

You can download a .zip file illustrating the problem here: http://www.thelawsplace.com/sdlogissue.zip

The .zip contains a conventional and an SD log made on the same trip (both logs should include the entire trip), as well as the converted SD log and the current tune file.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

Is it just the one card?

From the SDcard fields in your regular datalog it looks like the card is either corrupted or faulty. At around 810 in the log it fails to write a sector and then reports an error.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

Re: SD logs sometimes getting truncated?

Post by elaw »

The card I took that particular log on is new, but it was doing it on my other card too, and I've been using that one for years.

Unfortunately the RTC in my MS has a dead battery so it's hard to match SD with conventional logs, but I'll toss the old card back in there and take a few logs and see what happens.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

For reference, I was datalogging at the weekend on pre-1.5.1 beta 4. Once I'd resolved the mechanical connector issues (see http://www.msextra.com/forums/viewtopic ... 31&t=66020) my logs were ok.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

Re: SD logs sometimes getting truncated?

Post by elaw »

Interesting!

I'd read that thread but I just realized something... although this may be a bit off-topic. It sounds like there's a switch in the SD card holder that detects when a card is present? Because my MS box is in a very inaccessible location, I'm using an extender like this: https://www.ebay.com/i/282279646381?chn=ps&dispItem=1 for the SD card. I'm guessing that will cause the switch to think there's a card present even when there's not.

On another off-topic matter: is there any chance the PID logging parameters will be able to be put into regular (instead of SD) logs? Although I usually keep an SD card in there just in case something unexpected happens, the real reason I've been paying attention to the SD logs lately is the PID values.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

I'd be wary of using an extension cable. The SPI signals for the SDcard are not designed to go outside the box, that could be your problem.
There are no plans to include the PID parameters in regular datalogs.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
racingmini_mtl
Super MS/Extra'er
Posts: 9128
Joined: Sun May 02, 2004 6:51 am
Location: Quebec, Canada
Contact:

Re: SD logs sometimes getting truncated?

Post by racingmini_mtl »

I'd agree that running an unshielded SPI cable in an automotive environment is probably asking for trouble.

Jean
jbperf.com Main site . . . . . . . . . . . . . . . . . . . . . . jbperf.com Forum
Image
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

Although I had success this weekend, Andy W has reported a similar kind of thing. He hasn't been able to capture a regular datalog of it.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

Re: SD logs sometimes getting truncated?

Post by elaw »

Yeah I'm tempted to say that extender notwithstanding, my setup has been working fine for years. But the honest truth is I haven't been paying very close attention so the problem may have been there all along!

Once I find some time to change the RTC battery, I'll try plugging the SD card in directly and running for a while and see what happens.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

Good news! (Kind of) I had a short file show up this weekend gone. I'm not 100% sure what caused it, but I've made some small code changes to hopefully resolve it.
The first change removes a potential variable conflict. The second change checks that the file is a sensible size and creates a new one if it isn't.

I'll get pre-1.5.1 beta5 out soonish.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

Re: SD logs sometimes getting truncated?

Post by elaw »

Cool!

For what it's worth I set the SPI comms speed to "slower" and my setup seems to be happy, even with the extender. I haven't checked every single log file but all I've looked at seem okay.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

Andy tried my changes a few weeks ago and reported similar problems. I haven't got anything new to show at the moment, but have been trying things out in the background.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
jsmcortina
Site Admin
Posts: 39587
Joined: Mon May 03, 2004 1:34 am
Location: Birmingham, UK
Contact:

Re: SD logs sometimes getting truncated?

Post by jsmcortina »

Eric,
have you had chance to try out recent firmwares? There have been a number of internal SDcard changes. I've got some more coming out in beta7 shortly too.

James
I can repair or upgrade Megasquirts in UK. http://www.jamesmurrayengineering.co.uk

My Success story: http://www.msextra.com/forums/viewtopic ... 04&t=34277
MSEXTRA documentation at: http://www.msextra.com/doc/index.html
New users, please read the "Forum Help Page".
elaw
Super MS/Extra'er
Posts: 2926
Joined: Fri Oct 16, 2009 6:20 am
Location: Wilmington, MA

Re: SD logs sometimes getting truncated?

Post by elaw »

James,

I upgraded to beta 6 about 2 weeks ago. I haven't driven the car a lot since then, but captured 13 SD logs and they all look good!

I still suspect in my case the issue was related to SPI speed + the SD extender I'm using. I think when I upgraded to 6 I tried setting the speed up a notch and got SD errors, so I put it back down to the lowest setting where it has remained.
Eric Law
1990 Audi 80 quattro with AAN turbo engine: happily running on MS3+MS3X
2012 Audi A4 quattro, desperately in need of tweaking

Be alert! America needs more lerts.
Post Reply