3 Commits

Author	SHA1	Message	Date
dan	03e5e4fe4d	[svn] recur.c (parse_robots): Applied Edward J. Sabol's patch for Guan Yang's reported ... problem with "User-agent:<space>*<space>" lines.	2000-03-02 13:28:59 -08:00
hniksic	f4f8e83327	[svn] Applied Edward Sabol's patch.	2000-03-02 05:28:31 -08:00
kwget	31d6616c48	[svn] Initial revision	1999-12-01 23:42:23 -08:00