Question to Encoders: File Sizes getting out of hand?

[jpwong]

Well, you have to admit, the 175 MB episode was in the era of 640x480. These new 1280x720 fansubs technically have 3 times as many pixels to encode. So even with the advent if x264 encoding, we probably shouldn't be too surprised that video sizes doubled.

Storage isn't a problem for me, but my bandwith cap is.

[Dark Shikari]

Originally Posted by jpwong

Well, you have to admit, the 175 MB episode was in the era of 640x480. These new 1280x720 fansubs technically have 3 times as many pixels to encode. So even with the advent if x264 encoding, we probably shouldn't be too surprised that video sizes doubled.

Storage isn't a problem for me, but my bandwith cap is.

I did an SSIM test yesterday with various formats on a 5000-frame SD anime clip at 250kbps:

x264 0.99194
WMV 0.94875 (latest Expression Encoder)
Xvid 0.96128
Theora 0.92555 (latest Thusnelda nightly)
MPEG-2 0.94657 (ffmpeg, 250-frame GOP)

x264 beats Xvid by a factor of ~4.8... so perhaps that video size doubling isn't necessary

[Daiz]

so perhaps that video size doubling isn't necessary

Don't forget to take into account the fact that sources have improved tremendously too. Back then the most you could get was pretty much a shit DivX 704x396 (or even gasp, 1280x720, encoded with ancient DivX too) file from Share filled with all kinds of encoding artefacts known to man, while these days Transport Stream and BDISO sources aren't unusual at all. So not only has the resolution increased, the amount of source quality has gone tremendously up too.

Though now with the introduction of mbtree, I think it's pretty safe to say that we can lower filesizes quite a lot without losing any quality (well, except for fades but hopefully weightp will come out and fix that quite soon)

[misteranonimous]

Is there any reason why a file encoded at CRF 21 is larger than a file encoded at CRF 19?

[Dark Shikari]

Originally Posted by misteranonimous

Is there any reason why a file encoded at CRF 21 is larger than a file encoded at CRF 19?

Not in particular, do you have a test case beyond a vague post with no information?

[misteranonimous]

[Raws-4U] Nogizaka Haruka no Himitsu ~Purezza~ - 07 (MX 1280x720 H.​264 AAC).​mp4 Website Size: 357.81MiB

[Leopard-Raws] Nogizaka Haruka no Himitsu ~Purezza~ - 07 RAW (MX 1280x720 x264 AAC).​mp4 Size: 313.95MiB

Raws-4U is CRF 21

Leopardraws is CRF 19

I downloaded both files and was wondering.

[Dark Shikari]

Originally Posted by misteranonimous

[Raws-4U] Nogizaka Haruka no Himitsu ~Purezza~ - 07 (MX 1280x720 H.​264 AAC).​mp4 Website Size: 357.81MiB

[Leopard-Raws] Nogizaka Haruka no Himitsu ~Purezza~ - 07 RAW (MX 1280x720 x264 AAC).​mp4 Size: 313.95MiB

Raws-4U is CRF 21

Leopardraws is CRF 19

I downloaded both files and was wondering.

They're two totally different encodes--different settings beyond those of CRF, and for that matter may have different sources and/or different preprocessing filters.

[Hari Michiru]

Well, I want to watch stuff in HD, but .mkv files are just too big for my hard drive to keep that many shows in it (yes, I archive, so what?), and I can't re-encode it into the iPod format easily enough (yes, I don't have time to learn all that technical stuff...). I wished groups would release in both, just to give people a choice.

And to those HD elitist, not everyone has an uber fast computer that can run ANYTHING...

/end rant

[TheFluff]

Originally Posted by Hari Michiru

Well, I want to watch stuff in HD, but .mkv files are just too big for my hard drive to keep that many shows in it (yes, I archive, so what?), and I can't re-encode it into the iPod format easily enough (yes, I don't have time to learn all that technical stuff...). I wished groups would release in both, just to give people a choice.

And to those HD elitist, not everyone has an uber fast computer that can run ANYTHING...

/end rant

thank you for your input, i have seen the error of my ways and will be releasing everything in 320x240 mpeg1 from now as it is the most compatible format

[max2k]

Originally Posted by TheFluff

thank you for your input, i have seen the error of my ways and will be releasing everything in 320x240 mpeg1 from now as it is the most compatible format

From the downloadcount AVC in AVI, encoded with WMM3 is the way to go. Need a guid for this, i never ever even touched Windows Movie Maker and was impressed that it can handel h264, and i think as long as the container is avi most peopel will be happy. Who needs the b-pramyd?

[Heibi]

Originally Posted by max2k

From the downloadcount AVC in AVI, encoded with WMM3 is the way to go. Need a guid for this, i never ever even touched Windows Movie Maker and was impressed that it can handel h264, and i think as long as the container is avi most peopel will be happy. Who needs the b-pramyd?

The way I see it, I'm doing this for myself not anyone else. So whatever I release, people are free to download it. If they want special file sizes and such, they can invest their own time.

[shirohamada]

i encrode 1080p at 100MB

[Haruyasha]

Sigh, I wish certain groups actually knew how to encode properly.

[fireshark]

>>Hari Michiru
If your computer can handle HD content, it can encode iPod at a pretty quick clip. Especially if you resize to 320x240 (iPod resolution) encoding gets pretty fast. For 720p content, encoding to CRF21 with LanczosResize to 240p, reencodes usually putter along at ~60fps. (Intel T6400)

[lubczyk]

To all you CD/DVD collectors: Are you aware of such a thing as disc rot? Most of those CDRs and DVDRs you encode will not work within 5 to 10 years due to slight errors in recording and disc rot over time.

CD-R and DVD-R are disposable media that are not meant for archival storage.

I use DropBox, personally.

https://www.dropbox.com/

Of course, I don't backup my anime. They're fansubs. I don't know music CDs, DVDs or tapes anymore. They're disposable. with anime and basically every other media being basically on demand, I see no need to archive fansubs.

[K!R4]

you know that depends on the people archivin these media (burned or retail disc) whether theyre goin to work or not after 5-10 years. if you take care of your stuff, i bet theyd work and last 20 years or forever. if youre like a retard who keeps his stuff lying around with crap and dont give a shit where its place after theyre used, i bet a newly burned or bought DVD/CD will stop working after one day.

fyi: i have old dvds and cds that were burned and bought way back late 90s and are still fckn workin, so i dont see any problems for people who are still using dvdr to archive files or buying retail dvd/cd or bluray. anyway, i stopped using verbatim shits long ago not because theyre not good dvdr but because theyre fckn expensive as hell. i switch to taiyo yuden dvdr which are pretty much the same as verbatim's quality and much cheaper.

[Desbreko]

Unless you set up your drives in a RAID array, it seems more likely for hard drives to crash and burn within ten years than it is for high quality, carefully stored DVDs to become corrupt. If you use crappy, generic brand discs and scratch the hell out of them like most people do, then sure, they're not going to last long. But I have plenty of CD-Rs and DVD+Rs that have outlived multiple hard drives.

[fireshark]

It has become a problem recently with high capacity hard drives that with so high a capacity, at some point or other in the drive's life the unrecoverable error rate will be hit, somewhere. Your crappy media is not alone.

[lubczyk]

Originally Posted by fireshark

It has become a problem recently with high capacity hard drives that with so high a capacity, at some point or other in the drive's life the unrecoverable error rate will be hit, somewhere. Your crappy media is not alone.

Dedicated online backup? That's what I use. I'd never trust CD-R or DVD-Rs.

[fireshark]

Dedlcated online backup? And what if you don't have the bandwidth to do it? At least here un the US, some of us are still stuck with crappy connections, and re"archiving" BD rips at 40kb/s is not my idea of a good day.