Big Data Handling Tutorial

[kelle]

Big data handling - I have a data file (FITS image, big ascii table) that i want to manipulate that is a few gigabytes...reading it in, not screwing up memory, doing operations, writing it back out again.

pros and cons vs IRAF vs CASA
read in FITS in parts. manipulate, write back out in parts?

@keflavich & @demitri

[keflavich]

I'd like to know how to do this, yes.

On Tue, Oct 8, 2013 at 10:15 AM, kelle notifications@github.com wrote:

Big data handling - I have a data file (FITS image, big ascii table) that
i want to manipulate that is a few gigabytes...reading it in, not screwing
up memory, doing operations, writing it back out again.

pros and cons vs IRAF vs CASA
read in FITS in parts. manipulate, write back out in parts?

@keflavich https://github.com/keflavich & @demitrihttps://github.com/demitri

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/20
.

Adam

[astrofrog]

Or using memory mapping (used this recently to create a several dozen Gb image)