2011-07-27, 08:07 | Link #41 |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Thanks for the notice.
The following new anti-spam rule is in effect: Posts made by the default Yenc poster (=what you get when you don't change the settings) will now be considered spam if there are more than 10 posts in 24 hours and the posts do not contain split files (.001, .002 etc). This user is pretty much only using RAR files, so all posts he made were marked as spam (=hidden). For legit usenet posters: the easiest way not to get caught by this anti-spam rule is to simply change the default Yenc poster settings. Alternatively post your fansubs and other media as split files, there really isn't an excuse to use RAR files except for large file collections (not relevant for fansubs - always post multiple episodes individually). Extra compression hardly works on AVI/MKV and the maybe 1-2 MB saved does not weigh up to the extra post-processing downloaders need to do with RAR files. |
2011-09-08, 06:25 | Link #42 |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
A little update about Fanzub.com:
I'm currently working on a major rewrite of the site. Some features I hope to implement are: - Counting of NZB downloads (preparation for a "Popular Downloads" feature) - Caching of NZB files (no more time-outs on huge NZB files) - Allow full browsing of all categories with paginating (so you can view more than just recent entries) - Ability to download multiple files as one NZB (saves some clicking) However the majority of the work is actually "under the hood" rather than visible: not just some of the code is getting rewritten, but the entire database is being reconstructed as well. The reason for this is that the current site has poor article matching, causing lots of duplicate articles in the current database. As a result there are lots of duplicate posts as well. In addition to better article matching I've also written a far more powerful post "scanner" (script that tries to group a number of articles into one "post"). The old one was fairly simple: it simply chopped some parts of the subject line (certain extensions, part indicators etc) and tried to match different article subject lines mostly on filename. This worked okay for fansubs where each post is a single file; but it completely failed for music posts where each article may contain a completely different track number + title for a single album. The new post "scanner" can handle music posts much better. It will also skip most spam by default as each post must be of a certain size to be added (so single file spam will be skipped). As the database is about 5 gigabytes (with 5+ million articles) this takes quite a long time to process on my home development machine though, especially considering due to a bugs I have had to restart the process several times. I just had one of those moments: it turned out using array_merge() to merge two lists of message-ids was a really bad idea Anyway, this is just to let you know that I am working on the site. I will hopefully be able to put the reworked site online in a few weeks time. |
2011-09-08, 12:33 | Link #43 |
Senior Member
Join Date: May 2006
Location: California
|
Could you also add the ability to select multiple files and download them as multiple NZBs with a single click, possibly zipped? This may sound like an odd request, but this would actually save me time and avoid the Alt.Binz bug which rarely hangs its PAR2 thread when using multi-file NZBs.
__________________
|
2011-10-17, 01:31 | Link #46 |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Sorry about it taking so much time though. The reconstruction of the database + rewrite of the post scanner was taking a ton of time.
I'm now at the stage where I got it working pretty much the way I want, but now I still have to implement some of the features I promised. NZB caching is already working (no matter how big the NZB file, it'll download instantly) and paginating (browsing all pages in a category) is too. The others shouldn't take to much time nor should be to hard to implement, so I hope to be able to put the new site online "soon". Here are some screenshots though: The "Music category is kind of screwed up" bit is gone from the FAQ, because music posts now simply work: And a comparison of the DVD category: BEFORE (current v1): AFTER (beta v2): Apart from the missing spam in the beta site (which I didn't remove manually; the new scripts are better at detecting it) you can also see that posts with very short (and undescriptive) filenames now show part of the post description to make them easier to recognize (this also works wonders for the "Raws" category). Last you can see it picks up quite a few posts that the old site completely missed. Last edited by GHDpro; 2011-10-28 at 05:42. |
2011-10-28, 11:21 | Link #47 |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
And it is done!
Finally Fanzub v2 is done. As I mentioned before, the main thing that took a long time to get right was the complete reconstruction of the database. The new header & post matching scripts are much "smarter" than before, which means more posts are detected (completely), more post are complete (especially large ones) and there are no more duplicates. The immediate effect of this is that the Music category now works as intended; no longer are there any music posts with just PAR files and no tracks The new post "scanner" also allows for a completely new category to be added: Hmanga (downloads & descriptions NSFW), which I didn't bother with because of the problems the old code had with the music category. There is one downside to this completely reworked database: the post ID number are reset. Before the most recent post ID number was somewhere 300K+, now it is around ~170K partially because the new post "scanner" is more effective at catching spam. That might cause some issues with applications that use download history (of previous NZB files) to determine what they have downloaded and what NZB files are new. Hopefully the problems will not be all too severe. If you only use a browser to access the site (and not say, some kind of RSS reader) you should hardly notice this. The other new features are (as mostly mentioned before):
Update Oh dear, the new post IDs seem to be causing chaos, at least what I'm seeing in the download counts table and in my own SABnzbd+ client. Because the URLs for matched RSS entries are different SABnzbd sees them all as new downloads, and if I hadn't stopped it myself it would have gone on to download gigabytes of stuff I had already downloaded. I sincerely hope nobody is to severely impacted by this. If you haven't done so already, it might be best to check your download queue now if you use automated RSS downloading. Last edited by GHDpro; 2011-10-28 at 12:01. |
2011-10-28, 14:43 | Link #48 |
Senior Member
Join Date: May 2006
Location: California
|
Can you make a minor change so Middle Button Mouse Click doesn't select entries? I'm having an issue with it selecting a bunch of random stuff when I'm just trying to scroll the page with Auto-Scroll.
Possibly also add a button at top and bottom for 'Select All' & 'Deselect All' (as an alternative to mouse click dexterity), and 'Invert Selection' (alternative way of selecting things), and add the 'Get NZB' button to the top as well (so you can do selections starting at the bottom of the page to the top). Also add an advanced search? Search in specific newsgroups only. Search by poster. Search by minimum size. Search by maximum size. Search by age. Search only posts with an NFO (and allow NFO download/view from index?) Is an Advanced Search functionality like this easily possible with your Fanzub 2.0 search implementation?
__________________
Last edited by cyberbeing; 2011-10-28 at 14:55. |
2011-10-28, 16:37 | Link #49 | |||||
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
My main problem with some of your suggestions is that I want to keep the interface as clean and uncluttered as possible. This basically means dumbing it down a bit and not showing too many options that a lot of people might never use.
That said, some of the suggestions you make could be implemented through some kind of "Settings" page (cookie based, so no account registration necessary). Quote:
If it is because you are using the touchpad of a laptop with scrolling & tapping enabled I'd recommend getting a real mouse, or disabling tapping (which I personally absolutely hate -- I still use touchpads strictly the classic way). Quote:
I'm not sure how useful invert selection is. "Get NZB" on top could be an option for a "Settings" page. Quote:
There is already a hidden feature to do this, though it is not very practical to use because you need to know the "author ID" of a poster and that isn't publicly displayed anywhere. But for example this page lists all posts made by comfun: http://www.fanzub.com/?q=&author=2625 Anyway, what would be a practical reason why you would want to do this? I don't really see the point. Again, why would you want to do this? This could be a "Settings" page option. Quote:
Quote:
Anyway, the way I envision the site should be ideally used as is that you start by crafting a search query as specific as possible for what you want. So for example you don't search for "index" and then mark all the files by "Hatsuyuki" in "1280x720" that you want, but you search for "hatsu index 720" instead. Then you double-click to select all files and then individually deselect the files you don't want (for example the v1 for files with a v2 available). |
|||||
2011-10-29, 00:11 | Link #51 | |||||||
Senior Member
Join Date: May 2006
Location: California
|
Quote:
Quote:
It can be very useful at times when you want nearly everything on a search result page, but there are a couple items you don't mixed in. Make a smaller selection, hit the Invert Selection button and save a few clicks. Quote:
Quote:
To check what (if anything) a person has uploaded in the past when you see a questionable upload? Quote:
Quote:
One last thing I've mentioned before but almost forgot. Boolean logic and other similar things: Keyword exclusions -unwantedkeyword Exact phrases "phrase I want" Search for two phrases but not both in the same file keyword1 OR keyword2 I use all of the above daily on Google to prefect my results, don't you? Nowadays I go crazy at the massive efficiency loss when I'm restricted to basic keywords only. Librarians and anybody else who does serious research for their job, would also praise the usefulness of advanced google-fu functionality in search engines. Quote:
As long as Fanzub lacks some of the standard features expected on any Usenet index, you are artificially restricting its usefulness. This prevents it from becoming a one-stop Usenet Index, even for the content you specialize in. When I go to Fanzub to look for something, I hate being forced to go back to other indexes to search for the stuff Fanzub specializes, only because I can't make Fanzub do what I want. Fanzub is great at what it does do, but the extremely basic functionality and simple layout is restrictive to more advanced users. There is no reason you can't have both basic features and advanced features for those who want/need them, correct?
__________________
Last edited by cyberbeing; 2011-10-29 at 00:21. |
|||||||
2011-10-29, 01:34 | Link #52 | |||||||||
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Does not work, I'll have to look into this. Quote:
Quote:
Quote:
Having said that a slide-out "Advanced Search" like www.nzbindex.nl might be worth implementing (without messing up the "clean look"). However I can't promise any ETA. |
|||||||||
2011-10-29, 01:42 | Link #53 | |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Quote:
I think it might be fixable: http://api.jquery.com/mousedown/ (see paragraph with most text in it) I'll have to do a bit of experimenting though. |
|
2011-10-29, 03:16 | Link #54 | ||||||
Senior Member
Join Date: May 2006
Location: California
|
Quote:
Maybe if you made it always default to doing 'Deselect all' first if you have anything selected, but do 'Select all' first if you have nothing selected, it would work better. Quote:
Quote:
Quote:
Quote:
Quote:
__________________
|
||||||
2011-10-30, 07:14 | Link #55 | |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
I've implemented the following enhancements/fixes:
Quote:
But the inclusion keyword can be very generic, like for example -xvid @poster comfun Last edited by GHDpro; 2011-10-31 at 12:27. Reason: @stats -> @files |
|
2011-10-30, 10:28 | Link #56 |
Senior Member
Join Date: May 2006
Location: California
|
Thank you for fixing the auto-scroll issue.
So @stats is anything after Files: ? It seems the @poster command is a bit buggy when the poster's name contains an @ sign. For example, this returns the results of two different posters.
__________________
|
2011-10-30, 14:46 | Link #57 | ||
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Quote:
Quote:
|
||
2011-10-31, 06:50 | Link #58 | |
Administrator
Administrator
Join Date: Jan 2001
Location: Netherlands
Age: 45
|
Quote:
As of now this means the old field name @stats no longer works. |
|
2011-10-31, 11:09 | Link #59 |
German Fansubber Geek
Fansubber
Join Date: Aug 2004
Age: 40
|
wow, thank you for your work. i really like the fanzub site and use it regularly.
(and now i know, why sabnzbd started to download all those files again. first I thought it was some bug in sabnzbd *g*) btw. i believe a lot of you guy are using sabnzbd to download the fansubs. i wrote a little autoprocess script, which uses the anidb api to rename the files and move them to a target directory. more infos here: https://github.com/Benni-chan/SABnzb...-for-Anidb.net (i'll do some updates in the future, especially if there are any wishes ) Last edited by Benni-chan; 2012-10-14 at 07:38. |
2011-11-01, 05:55 | Link #60 |
Junior Member
Join Date: Jan 2004
|
Hiya. Hope you guys won't mind me asking a few question on usenet. Only took notice of the service today LOL did a bit of read up but was kinda confused i guess. As i just moved countires and am currently in a country with super slow connection speed and very low quota 6-15GB........ usage so was looking to an alternative to BT, sadly enough the speed is so bad that irc also can't work lol. its takes 2-4 hours to dl 100mb using web browser with tons of drops.
Q: Is it a good idea for me to use it? Currently i have 2 internet connection one is 6gb quota with 7mbps speed and the other is 15 gb with speed worst then my 6gb connection and drops alot only good thing is mmo seems to runs almost smoothly Q: Is it possible to use it over my office network? it won't messed up the other user connection? Q: alot of the provider seems to mention increased speed? But i assumed your are still kinda locked by your own ISP speed? both my isp will drop the speed to almost 128kbbps once you hit the quota so i was wondering if the increased speed is locked to isp or not Q: is there any upload hidden or not? since quota = dl +ul Last Q: Does all usenet provider access the same thing? I found giganews while looking up usenet but kinda confuse does if all usenet connect as i notice that you mention " problem of finding files is the problem that your Usenet server may be missing one or more parts of the file." sorry for the trouble |
Tags |
wiki candidate |
|
|