big data file

Sujaya Neupane's Avatar

Sujaya Neupane

21 Sep, 2018 01:58 PM

Hi Chris,

My mworks datafile is somehow 20GB (need to figure out why). Is it possible to read some variables from the file without using too much RAM or loading the entire file?

Thanks,

--
Sujay

  1. 1 Posted by Sujaya Neupane on 21 Sep, 2018 02:00 PM

    Sujaya Neupane's Avatar

    Hi Chris,

    The file was 15GB today. There's something weird happening. Can I drop by to ask you a question tomorrow morning?

  2. Support Staff 2 Posted by Christopher Sta... on 21 Sep, 2018 02:03 PM

    Christopher Stawarz's Avatar

    Hi Sujay,

    Is it possible to read some variables from the file without using too much RAM or loading the entire file?

    Yes, but only in Python (not MATLAB). Please see the paragraph about get_events_iter in Selecting Events.

    Can I drop by to ask you a question tomorrow morning?

    Sure.

    Chris

  3. Christopher Stawarz closed this discussion on 24 Sep, 2018 01:50 PM.

Comments are currently closed for this discussion. You can start a new one.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac