1
0
mirror of https://github.com/moparisthebest/SickRage synced 2024-12-13 19:42:20 -05:00
Commit Graph

295 Commits

Author SHA1 Message Date
echel0n
161226180f Cleaned up NyaaTorrents search code and fixed unicode issues. 2014-07-24 01:33:38 -07:00
echel0n
a697805923 Fixed NameParser to properly parse anime episodes that use normal season and episode naming conventions.
NameParser now properly creates absolute numbers from season/episode info or season/episode numbers from absolute info for anime shows. Removed scene convert routine and migrated the code into the parsing routine with a boolean to scene convert if needed.

Fixed NyaaTorrents issue with dict object errors.
2014-07-24 01:27:35 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
3a2b67330c During backlog/manual/failed searches we now cache disgarded/ignored results pre-parsed for usage later on incase we end up setting a episode to wanted that matches said results, allows for maximum performance and helps limit the waste of resources used. 2014-07-21 23:00:58 -07:00
echel0n
a317ff61c2 Created a context manager wrapper for BeautifulSoup4 so that we can cleanup/clear tags/context on exit via WITH statements.
Fixed issues with torrent providers returning no results.
2014-07-21 21:26:58 -07:00
echel0n
899d03b5fe Fixed issue with appending UNNOWN qualities to provider results after being sorted. 2014-07-21 18:48:16 -07:00
echel0n
bf41ba59be Fixed sorting provider results by quality code, was causing a error. 2014-07-21 17:55:45 -07:00
echel0n
403c267953 Further improved memory handling of bs4 for torrent providers. 2014-07-21 16:01:46 -07:00
echel0n
4a29476415 Added code to perform disposal of bs4 class when finished as well as perform garbage collection afterwards, this fixed a memory leak issue SR was experiancing during backlog/manual/failed searches. 2014-07-21 15:16:04 -07:00
echel0n
f340f9b073 Fix for sports shows. 2014-07-21 08:49:20 -07:00
echel0n
6f817c0c5c Quality sorting fixed for provider results.
Reverted newznab search strings being confined to just season till we can find a better way of correcting the issue with Usenet Crawler.
2014-07-21 08:38:56 -07:00
echel0n
39054d7810 Fix for validating episode data during provider result gathering. 2014-07-21 07:21:03 -07:00
echel0n
7b54611361 Moved code for marking failed download successful out of loop.
Newznab providers now create season search strings for all searches as single ep search strings combined with using rage id numbers seems broken currently.
2014-07-21 06:44:01 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
echel0n
57cf86279b Places Quality UNKNOWN items from provider results at end of itemsList leaving order of sorted items highest to lowest. 2014-07-20 23:59:57 -07:00
echel0n
d6442e0685 Provider results get sorted by quality before filtering occures. 2014-07-20 23:43:52 -07:00
echel0n
af0ccd65cf Fixes for a few provider issues plus passing of search_mode variable. 2014-07-20 22:47:13 -07:00
echel0n
ff5107cfe2 Provider searches for backlog, manual, and failed have been re-worked to not hammer the providers so much plus perform alot faster. 2014-07-20 22:07:53 -07:00
marseneault
662353e936 Add support for Bitsoup 2014-07-20 12:12:22 +08:00
Justin Nielsen
ad17b81560 Added TVTorrents.ro Provider
Missed some files

Removed seeders==0 as per request
2014-07-20 11:09:26 +08:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
09f53d3537 Filtering of torrents with 0 seeders is no longer forced, filtering now is done strictly by min seed and min leech user settins which can be set from search provider config settings. 2014-07-12 16:16:58 -07:00
echel0n
21cc92664f Fix for KickAss Torrents Invalid URL error. 2014-07-11 21:12:25 -07:00
echel0n
b7ab95996c Merge pull request #638 from adam111316/add_animezb_provider
Add animezb provider
2014-07-11 19:40:51 -07:00
echel0n
2d87de0fd8 Fix for search provider config page errors. 2014-07-11 14:57:49 -07:00
adam
923a58b2ab Add animezb provider 2014-07-12 01:21:56 +08:00
echel0n
aa74dfb68d Merge pull request #637 from marseneault/torrentbytes
Add TorrentBytes provider
2014-07-11 10:18:08 -07:00
echel0n
0e3495d30f Fix for show parsing errors to be displayed via debug logs now instead as a warning. 2014-07-11 00:59:05 -07:00
root
6304c5ed17 Add TorrentBytes provider 2014-07-10 10:15:44 -04:00
echel0n
e891e9d637 Fixed nextaired not found issues and fixed kat provider issues. 2014-07-09 09:01:12 -07:00
echel0n
f925488373 KickAss torrents now uses multiple urls to try from incase one goes down. 2014-07-09 01:26:45 -07:00
echel0n
15c7332277 Merge pull request #623 from nielsenj/customrssratio
Adds custom RSS provider ratio setting.
2014-07-08 09:53:07 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
a3a3777d33 Fixed blackAndWhitelist for anime release groups. 2014-07-06 04:12:16 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
36e12a5d4d Fix for hdtorrents uid issues. 2014-07-02 13:39:27 -07:00
echel0n
ddd9376faf Fix for torrentday uid issues. 2014-07-02 13:38:05 -07:00
echel0n
d6431570f1 TPB season pack searches fixed 2014-07-02 13:06:29 -07:00
echel0n
12ac388dc2 Fixed startup/restart/shutdown issues on Windows, Linux, FreeBSD platforms tested.
Fixed for updating issues.

Fixed high cpu and memory usage.
2014-07-02 11:51:14 -07:00
nielsenj
6d8e79c78a Adds custom RSS provider ratio setting.
Adds ratio setting to the custom RSS provider.
2014-06-30 22:48:49 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
echel0n
0c57676aed Updated tornado source code.
Created custom class for rss feed parser.
2014-06-29 03:05:33 -07:00
echel0n
e0eea79ec5 Fix for ABD and Sports shows issue with toordinal function. 2014-06-25 21:39:34 -07:00
echel0n
61e1e5d2c2 Fix for __exit__ DB errors 2014-06-21 18:35:57 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
7ce409e90d Merge pull request #612 from JackDandy/port_fix_BTN_duplicate_search_params
Port:Fix BTN adding same search parameters multiple times.
2014-06-19 09:47:45 -07:00
echel0n
1fa8686422 Merge pull request #610 from JackDandy/port_fix_omgwtfnzbs_findPropers
Port:Fix omgwtfnzbs findPropers.
2014-06-19 09:46:58 -07:00
JackDandy
ff524fc7e4 Port:Fix omgwtfnzbs findPropers. 2014-06-19 16:37:29 +01:00
JackDandy
42f018bf06 Port:Fix BTN adding same search parameters multiple times. 2014-06-19 16:36:13 +01:00
fittysix
c5045d0f1e Add moderator to confirmed torrent posters
I think we can trust these guys :)
2014-06-18 07:04:16 -06:00
echel0n
98ff924b1c Fix for nullhandler issues for py2.6 users,
Fix for rsstorrents.
2014-06-17 08:46:07 -07:00
echel0n
d73cc1cbbd Replaced cherrypy with tornado which helped resolve our memory leak issue. 2014-06-14 20:56:15 -07:00
Adam
5fd0a2a1f3 Fix for Newznab providers when searching for a show without a tvrage id we use the name of the show. If the show name is more than one word we are using a _ as our delimiter which works fine unless the NN provider uses sphinx.. as the underscore then is used as part of the show name.. thus we always get back no results. We should just use . as it works for both sphinx and non sphinx servers. Tested this out on nzbs.org / nzb.su (sphinx) / sbi (non sphinx). 2014-06-12 11:19:27 +08:00
Nils
166dffeb5a Merge pull request #582 from bikemike222/add_cookies_rss
Added cookie support to custom torrent provider
2014-06-09 00:20:37 +02:00
echel0n
a1da7df12e Fixes for DB issues 2014-06-07 15:35:16 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
05dcdd72d7 Fix for air-by-date/sports/anime provider searches 2014-06-06 16:55:14 -07:00
echel0n
cab05efa64 Added anime search support and removed extra pipe symbole from search string. 2014-06-06 15:27:20 -07:00
echel0n
14201c71f3 Fixes issues with scene numbering being set to 0x0 after snatch is performed.
Fixes issues with KAT Provider sphinx error on searches.
2014-06-06 15:16:15 -07:00
echel0n
4df31bccee PublicHD removed till further notice. 2014-06-06 13:48:25 -07:00
Nils Vogels
0e989fe90f Limiting search to English-translated only (for now) 2014-06-02 00:05:07 +02:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
f01c5852d4 Improved find propers code.
Backlog and manual searches now check cache first for search results.
2014-05-30 00:51:24 -07:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
7e711c0665 Fix for find propers and newznab providers 2014-05-26 01:05:47 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
Bike Mike
89c944ec94 Added cookie support to custom torrent provider 2014-05-25 19:19:45 +02:00
echel0n
a350be339c Fix for issue causing issues loading and saving search providers 2014-05-23 09:35:01 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
d37a992508 Fixes issue with trailing slash being appened to end of url when adding custom RSS torrent provider. 2014-05-22 22:36:48 -07:00
echel0n
736cb7c738 Fixes issues with ABD shows searching for complete seasons and returning zero results. 2014-05-22 22:02:49 -07:00
echel0n
95adb131e1 Revert "Fix for findpropers and newznab providers"
This reverts commit cfa5d99066.
2014-05-21 12:08:08 -07:00
echel0n
cfa5d99066 Fix for findpropers and newznab providers 2014-05-20 22:50:56 -07:00
echel0n
8141d8a170 Fixed issues for custom RSS torrent providers 2014-05-20 20:22:48 -07:00
echel0n
d6a942698a Fixes errors caused by duplicate newznab providers 2014-05-20 13:51:54 -07:00
echel0n
fa11b4ef3a Removed some sleep timers to improve overall speed of sickrage. 2014-05-20 11:01:51 -07:00
echel0n
9e1402057a Added in min seed and min leech options for torrent providers 2014-05-20 09:06:11 -07:00
echel0n
5f328eba5f Converted NZB providers to new dynamic config style format. 2014-05-19 19:14:06 -07:00
echel0n
3918917f7a HDBits fixed! DOn't question just say ... thankyou ;) 2014-05-19 14:25:33 -07:00
echel0n
f0bd8e5e4a Fixes issues with processTV failed downloads and HDBits auth info 2014-05-19 13:06:32 -07:00
echel0n
854de69683 Fixed find propers.
Added ability to force a find propers search.
2014-05-19 10:40:25 -07:00
Nils
621f790392 Merge pull request #573 from JackDandy/FixSearchNzbsOrg
Fix: Searching for propers/repacks at nzbs.org.
2014-05-19 19:03:06 +02:00
echel0n
2a5598ba0f Fixes issues with settings and newznab providers. 2014-05-19 08:22:18 -07:00
echel0n
c6b064de23 Fixed small typo causing scene numbering to indexer numbering issues 2014-05-19 06:57:20 -07:00
echel0n
e7931f0c7f Added Torrage.com as alternative site to Torcache.net 2014-05-19 06:27:38 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
de20d13c61 Added per-provider option 'backlog only' which allows you to disclude any provider from the daily search but still use it for backlogs, currently working for torrents only and will add to nzb providers later on today.
Cleaned up details on search options for providers and made it look nicer
2014-05-18 09:39:30 -07:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
echel0n
c65573a8d7 Re-wrote daily searcher to search for unaired and wanted episodes going back as far as 1 week, also moved it so it queue's its items now.
Cleaned up description of new per-provider season search options.
2014-05-18 05:59:42 -07:00
Nils Vogels
215f0cdb46 Adding missing character in URL 2014-05-18 02:15:13 +02:00
Nils Vogels
da8e2e3d19 Path detection for icons was still in midgetspy format.
Changed paths to our gui
2014-05-18 01:17:16 +02:00
echel0n
55f27c4f40 rss cache updates and daily search have been joined into one function.
fixed more issues of missing vars causing saving of config issues.
2014-05-17 11:14:48 -07:00
JackDandy
7e48e827f7 Fix: Searching for propers/repacks at nzbs.org.
If no results are found with the usual search URL, an alternate is tried.
2014-05-17 18:59:33 +01:00