I am working with relatively large CSV files (1.5 MB+) and while testing the code, I have to frequently open up the CSV files to read a particular row, validate the data are there and then close the CSV file and move to another one.
Files which are larger than 1.5 MB are taking about 40 seconds per file open on my computer. Is there any tool that will allow me to open large CSV files quickly (I am only looking to read the CSV file and therefore a CSV reader that opens up files quickly will be useful)
Alternatively, if there is any tool that will perhaps when the first 1000 lines or the last 1000 lines will be good. I know I can do this in UNIX by using commandline utilities but then they dump the data in different files and again I will have to delete those files. Moreover, I'm looking for a solution on Windows.
I hope somebody can help resolve this. Thank you for any inputs!