[dev] insanely duplicated tags in Tags page
Hi, I'm making an analysis using Safebooru's tag information.
Since I need 'general' type tags only, I made a parser which ask whether a tag is general or not. It simply fetches Tags page, and read the type column.
At first, it works well... But soon I realized that, some tags(I'm not sure how many they are) are duplicated seriously! For example, just give it a gaze for 'multiple_girls'. Boom!
I can't analyze such tags, since webpage just print "354534 results found, refine your search." to me.
I dont' have any idea how to judge the type of tag without using Tags page.
Since I need 'general' type tags only, I made a parser which ask whether a tag is general or not. It simply fetches Tags page, and read the type column.
At first, it works well... But soon I realized that, some tags(I'm not sure how many they are) are duplicated seriously! For example, just give it a gaze for 'multiple_girls'. Boom!
I can't analyze such tags, since webpage just print "354534 results found, refine your search." to me.
I dont' have any idea how to judge the type of tag without using Tags page.