Breaking a huge CSV or text file into chunks so multiple scripts can process them at once.
Alex needs to email the last 500 MB of logs to the senior developer for analysis. But the company email server rejects attachments larger than 25 MB. Also, Alex’s own text editor crashes when trying to open the file directly. linux split file
The checksums match. Success.
This command creates a chunk of 10MB from the largefile . Breaking a huge CSV or text file into
tar -cf - mydirectory | split -b 10M - tar_ linux split file