How can I read rows from a CSV outside of datalines using readtable (2024)

Okay, that's unfortunate. Follow-up question:

So now I have my tHdr where the _x variables contain the start and end timestamps, and T which contains the actual data and _x variables contain seconds since start stored as double.

How can I best combine them? I think I have to loop through the _x variables and create a vector (per variable) using data from both tables. But when I try to replace the seconds with actual timestamps I can't because the existing variable is double type.

Is my best option just creating a new table instead of modifying the existing ones?

Thanks

Here's what I have so far:

It would be easiest to illustrate with actual data file, but the answer is to read the seconds columns as the <duration> type which you can then add to the starting datetime.

I didn't try to parse the above(*) to figure out just what you're trying to do there with all the conditionals, but set the 'X-Values' input data type to 'Duration' and the corresponding 'DurationFormat' as 's'

You can then use addressing in the table by the <vartype> function which returns a subscripting variable as

where tT is your data table and tStart is the starting time datetime value.

You can also leave the input sample times as the double and use seconds to convert them to the duration afterwards, but since you're going to the trouble to build the import object to match the data file, why not finish the job there?

(*) Attach code snippets as text formatted with the "Code" button (or select text and use Ctrl-E is easier); nothing anybody can do with images directly.

That's helpful, thanks. How to import duration values is what I need. But I just get NaN sec when I set it to duration.

According to the docs, duration does not support seconds by itself. My data is <secs>,<milliseconds> which I guess I can't import directly? Or the DurationFormat=s does not support fractional seconds?

The data 'ben.csv' that I guess you constructed from the data in my original post is entirely representative of the actual data (I'm actually using it for quicker testing). The seconds continue increasing and there are many more columns of xy pairs of data. I updated my original post with a few extra rows to get to full seconds. I also attached it to my above comment.

Also, I have inserted all the code with the button that says "Insert MATLAB code example" on the editor window and copied the code as text directly from a working MATLAB online file. But I can format my previous comment using the other code formatting.

It was indeed my hope to import the data with the formatting instead of fixing it after. But don't think I can import duration data like 35802,890410352 seconds (with , as decimal separator, that is 35802 seconds 890 milliseconds), which is the duration value from near the end of the file.

@Ben: unfortunately the DURATION class has a very restricted small set of valid formats which it can either display or accept as input text (given here). My guess is that you will need to import that data as numeric and then convert to DURATION using SECONDS:

Yeah, that's a gotcha'! on the duration class, indeed.

The datetime/duration classes are pretty new yet and not quite fully developed -- particularly the duration is yet to come fully of age on its limitations on formats.

This would be a great example to use as an enhancement request -- will see about crafting one...

Using the double and converting as @Stephen23 says isn't that bad to have to do, but would be cleaner if could go at it directly.

I might send a feature request too! It's unfortunate, but I will survive xD

Thank you both for your answers and support.

I was having some trouble getting the data into the table, as the data table has the time column as a duration and I can't replace duration data with datetime due to time mismatch. I was trying

where timeVec is a datetime vector. But MATLAB says timeVec needs to be a duration array.

I found that I could pass an anonymous function to convertvars which allows me to do what I want. See code below.

One thing not shown by the sample data is that not all columns have the same start time, which is why this is a loop that goes through each time column.

Mainly wanted to close this out with a working solution to the end. Also curious if I can do this without a loop, but it's not slow so unimportant.