Fix a bug that robotparser starves memory when the server responses
in HTTP/0.9 due to dissonance of httplib.LineAndFileWrapper and urllib.addbase.
Showing
Please
register
or
sign in
to comment
in HTTP/0.9 due to dissonance of httplib.LineAndFileWrapper and urllib.addbase.