How to read a large file using Python

Preeti Mathur

Edited On 5 NOVEMBER 2022

Category: Python

1 Answers
165 Views
0 Likes

In my python code i am using file open method with readlines() function to read the content from a txt file.

The code snippet works fine.

However it is observed that at times, when the size of the file pass beyond 100 MB, the program gets crash and abnormally termination.

Is there any other reliable method to read the contents from a large file using python.

Below is the sample code, i am using currently:

filehandle = open("file.txt", "r")
print(filehandle.readlines())

1 Replies

Answer Now

Python has an in-built module named fileinput which can be used for reliable file operations.

Methods mentioned in fileinput() works fine, even when used with large files size of certain GBs, so using it will definitely solve your concern.

I am providing a small code snippet which you can further expand as per your exact requirement:

import fileinput
for lines in fileinput.input(['file.txt']):
    print(lines)

You can fetch the contents of any large file through this without any abnormal termination or crash.

Published on 5 NOVEMBER 2022 at 9:10

0 Likes Reply

Ask Question

Users Leaderboard

Online Tools