[twitter] Fix stop before real end (#573)

* [twitter] Fix stop before real end

Fix for #544. Makes sure that it really reached the end by checking that both "min_position" is null and "has_more_items" is false before stopping.

* [twitter] Fix stop before real end (update)

gallery_dl/extractor/twitter.py

@@ -230,9 +230,12 @@ def _tweets_from_api(self, url, max_position=None):
             for tweet in text.extract_iter(
                     data["items_html"], '<div class="tweet ', '\n</li>'):
                 yield tweet
-
-            if not data["has_more_items"]:
-                return
+
+            if data.get("min_position") is None:
+                if data["has_more_items"] and "min_position" not in data:
+                    pass
+                else:
+                    return
 
             if "min_position" in data:
                 position = data["min_position"]