Releases: UltimaHoarder/UltimaScraper
OnlyFans DataScraper v5.8
You can now fully customize your file paths. Read path_formating in the readme.
You may have to redo your file_directory_format and filename_format settings since I changed the way it works.
OFRenamer will now search for every file in the model folder, as long as you have any unique identifier in file_directory_format.
Renaming and merging files work.
Bunch of performance increases.
Read the readme changes before opening an issue and if you're not using Python 3.9, I'm closing your issue. :))))))))))))
OnlyFans DataScraper v5.7
Increased speed of processing redownloaded content by skipping downloaded files.
Redownloading someone with thousands of posts will no longer be slow as hell.
Changed how merging old metadata into the new works.
This is my favorite release because it's way faster. If you're coming from 5.6.1, you won't see the speed increase until you've scraped someone twice with this release.
After this release, there's some stuff I'd like to add and improve, like:
Enable multiple profiles that would have their own config and data.
Rewrite the entirety of OFRenamer (lol)
Adding custom download_paths, as in "C:\Siterips\{site_name}\{username}\{api_type}\{value_type}\{media_type}".
That download_path would translate to "C:\Siterips\OnlyFans\belledelphine\Posts\Free\Images".
Custom metadata location
Renable STARSAVN.
Make rescraping even faster.
I'll probably make the script async also...
Prioritized list btw.
OnlyFans DataScraper v5.6.1
Fixed missing IP attribute.
OnlyFans DataScraper v5.6
Use Python 3.9.
The script is faster.
The script scrapes text.
The script merges old metadata in the new metadata.
Disabled all modules except for OnlyFans.
Removed CSV export.
OnlyFans DataScraper v5.5
Last release/commit before Python 3.9
OnlyFans DataScraper v5.4
It's faster and it works
OnlyFans DataScraper v5.3
It works
OnlyFans DataScraper v5.2
It just works
OnlyFans DataScraper v5.1
CONFIG CHANGES:
filename_format
Replaced {id} with {media_id}
Added {post_id}
2FA users must add auth_uniq_ cookie to the config
Directory is now named "download_path"
site name prefix in the download_path is now optional, but added by default
"{site_name}"
OPTIMIZATIONS:
Removed some log errors.
Changed socks5 to use socks5h instead.
MODULES:
Fixed auth issues and path issues.
FIXES:
Fixed shutil.SameFileError
I ended up having a 14GB error log because the script was trying to scrape invalid links. Fixed that.
FEATURES:
Ignore free or paid accounts
OFRenamer:
The script will now automatically convert filenames to the format in the config.
You can also use the script separately, just double click start.py
CONTRIBUTORS:
@Balgden (Added Python3 shebang)
This script requires Python 3. On most Linux distributions 'python' is a symlink to python 2. The only exception I'm aware of is Arch, which symlinks to python 3 instead. Luckily a more specific 'python3' is available on all distributions.
Fixes './start_ofd.py' on Ubuntu and other Linux distributions.
OnlyFans DataScraper v5.0
Optimizations:
Implemented A faster way to get your active subscription list.
Implemented A faster way to scrape mass messages.
Overhaul:
Renamed StartDatascraper.py to start_ofd.py
Config will update automatically.
Major directory changes:
"sites" > ".sites"
"settings" > ".settings"Folder structure by default is now:
Posts > Free > Images/Videos/Etc
Posts > Paid > Images/Videos/EtcSet sort_free_paid_posts to False if you want to use the original file structure which doesn't separate free/paid posts.
Metadata is now stored in the root of the model folder.
Everything used to be tied to the post API. If a post only had an image, the rest of the APIs would only download images even if they had video and audio files, so you'd be missing out on content basically.
Before:
Post API > Only has image files
Post API > Search for images
Message API > Search for imagesNow:
Post API > Only has image files
Post API > Search for image files
Message API > Search for the image, video and audio filesScript will automatically convert files to the new format.
Features:
Added socks5 proxy.
Fixes:
Fixed text not limiting itself.
Text will now be cleaned so it can be a valid filename format.
(Don't use "text" in the filename format, I've warned people multiple times. Don't use it. I don't wanna hear complaints that you have to redownload 10TB worth of data when you've already been warned. I don't care lol.)