-
-
Notifications
You must be signed in to change notification settings - Fork 6
feat: Improve shorts remove key and using tqdm for progress #12
base: feat-async-runner
Are you sure you want to change the base?
feat: Improve shorts remove key and using tqdm for progress #12
Conversation
90d769e
to
5333971
Compare
@alexandreteles I am not sure if opening a file handle everytime is done correctly here. |
This reverts commit 10927bb.
The async file handler deals with that. We could also open a single handler and share between the workers but that will require writing extra logic which |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@oSumAtrIX Can you test this once last time?
Please update the requirement file with tqdm. I don't have poetry installed 😅 |
I will first merge the other changes and then investigate this one again. |
Removing already marked watched beforehand can increase the perf. Changing "#short" to "short" because some title has #ytshorts