Error while writing file: set changed size during iteration

[aman25m]

Received the following error while running the code:

I believe that while writing, each thread is trying to access the same file due to which the error is occurring. Moreover, I have one doubt. In the below mentioned function:

def update_files():
    set_to_file(Spider.queue_file, Spider.queue)
    set_to_file(Spider.crawled_file, Spider.crawled)

The Spider.queue is common for all the threads, or each thread has its own Spider.queue when the thread is created and Spider.crawl_page() is called?

[HtetAungKyawhak]

Can you fixed that errors? If you can please share me, I also faced like that error! ;-(