17 OCT 2024 - Welcome Back to TorrentFunk! Get your pirate hat back out. Streaming is dying and torrents are the new trend. Account Registration works again and so do Torrent Uploads. We invite you all to start uploading torrents again!
Here is FINAL **volume V2023C for interval 06.2023-08.2023** in series of composite safebooru-based rips
[03.2023 - 06.2023](https://nyaa.si/view/1727186) volume V2023B
[12.2022 - 03.2023](https://nyaa.si/view/1720018) volume V2023A
[08.2022 - 11.2022](https://nyaa.si/view/1634287) volume V2022D
[05.2022 - 08.2022](https://nyaa.si/view/1574093) volume V2022C and their predecessors
aimed to feed **BOORU CHARS datasets [2021](https://nyaa.si/view/1384820) , [2015](https://nyaa.si/view/1468367) , [2022](https://nyaa.si/view/1547662)** and upcoming 2023
Following description is (recursively and) borely similar to previous volumes ones because of stable datapump.
**This rips are not intended to be "complete and maximum quality" but rather "representative the best of"
to help users not to loose interesting fandom or artist and get all stuff with several clicks.
Another reason to build this megalythe is neural network training over art images.
There are [promising results](https://github.com/aperveyev/booru_yolo), stay tuned.**
Sources used (_priorities high to low when deduplicating_):
* safebooru.org (ID 44xxxxx) **letter S** in archive/folder name
* yande.re (with some questionable images in separate Q-folders) **letter Y**
* danbooru.donmai.us (NSFW subset in Q) **D**
* e621.net (also with Q) **E** FURRY !
**147.650** images sorted and zipped according aspect ratio (dimensions 2 folders) _priorities high to low_ :
- **43729** "artbook pages" **7x10 (+/- 4%)**
- **23755** “wide pages” **3x4 (+/- 10%)**
- **29175** “squares” **1x1 (+/- 20%)**
- **27038** “wallpapers and computer screens” **3x2 (+/- 40%)**
- **23953** "high pages" **2x3 (+/- 40%)**
and also for _**source**_ and (sometimes) _**ID range**_, mentioned in _**folder/archive name**_.
You can browse pictures directly in archives with FastStone MaxView of something like it.
File names structure : **%website% - %id% - %up_to_3_copyrights% ~ %up_to_5_characters% (%up_to_2_artists%).%ext%** where
- %copyright% , %character% and %artist% may be used as filter for search on source booru
- %website% + %id% is unique and also may be used to get direct booru url
so you can extract subsets of interest with xcopy (from already unzipped images) or unzipping (from release on the fly) e.g.
```
for %%F in ("d:Safebooru 2023c*.zip") do 7z x -r -o"e:sortarea" "%%F" *shiguang*dailiren*
xcopy /s d:Safebooru 2023c*shiguang*dailiren* e:sortarea
```
**Transformations and filters:**
- initially filtered Mpixels >= 1.2, width >= 900, height >= 900
- PNG converted to JPG (quality 94%), no animations
- downsize to 60MPix and/or maxsize 9000 px, 18MByte+ images carefully mogrified
- tall/wide stripes dropped or adjusted to aspect ratio 0.4 .. 2.1
- manually (yep, plenty of ~~hand~~job behind this release)
- comic and 4koma, segmented scans and overtexted covers filtered out
- real-life photos, no-character landscapes, most of line-arts and primitive chibi thrown away
- too explicit images (uncensored nipples or vulva, obvious adult actions etc) excluded from "questionable" downloads
- crops done when large simple or dirty background, most artbooks de-bordered
- occationally gamma correction, denoise and other nontrivial improvements made
- carefully deduplicatied (with AntiDupl NET up to 4% similarity) along with several past releases
Some meta-information included in tab delimited files with evident header line:
- **V2023C_files.TSV** post info (size, resolution, MD5 etc) with concatenated copyrights / characters / artists tags (Excel capable)
- **V2023C_tags.TSV** all tags (incl. general and meta) one tag per line (4.495.126 rows not fit into Excel)
Using some database you can play with SQL and xcopy (from already unzipped images, copypasting query result) anything you want, e.g.
```
select 'xcopy "d:'||torr_path||''||file_name||'" e:sortarea ' xc
from files f
join tags t on t.booru=f.booru and t.fid=f.fid
where t.tag like '%erection_under_clothes%' -- potentially NSFW
```
NOTE: **final** sampled dataset BOORU CHARS 2023 will consists of 2022C+D , 2023A+B+C , some old stuff and **a lot of consolidated metadata for all project**
