Skip to content

Releases: UltimaHoarder/UltimaScraper

OnlyFans DataScraper v5.8

23 Nov 16:51
Compare
Choose a tag to compare

You can now fully customize your file paths. Read path_formating in the readme.
You may have to redo your file_directory_format and filename_format settings since I changed the way it works.

OFRenamer will now search for every file in the model folder, as long as you have any unique identifier in file_directory_format.
Renaming and merging files work.

Bunch of performance increases.

Read the readme changes before opening an issue and if you're not using Python 3.9, I'm closing your issue. :))))))))))))

OnlyFans DataScraper v5.7

15 Nov 14:54
Compare
Choose a tag to compare

Increased speed of processing redownloaded content by skipping downloaded files.
Redownloading someone with thousands of posts will no longer be slow as hell.
Changed how merging old metadata into the new works.

This is my favorite release because it's way faster. If you're coming from 5.6.1, you won't see the speed increase until you've scraped someone twice with this release.

After this release, there's some stuff I'd like to add and improve, like:

Enable multiple profiles that would have their own config and data.
Rewrite the entirety of OFRenamer (lol)
Adding custom download_paths, as in "C:\Siterips\{site_name}\{username}\{api_type}\{value_type}\{media_type}".
That download_path would translate to "C:\Siterips\OnlyFans\belledelphine\Posts\Free\Images".
Custom metadata location
Renable STARSAVN.
Make rescraping even faster.
I'll probably make the script async also...

Prioritized list btw.

OnlyFans DataScraper v5.6.1

09 Nov 08:09
Compare
Choose a tag to compare

Fixed missing IP attribute.

OnlyFans DataScraper v5.6

08 Nov 11:44
Compare
Choose a tag to compare

Use Python 3.9.
The script is faster.
The script scrapes text.
The script merges old metadata in the new metadata.

Disabled all modules except for OnlyFans.
Removed CSV export.

OnlyFans DataScraper v5.5

13 Oct 21:09
Compare
Choose a tag to compare

Last release/commit before Python 3.9

OnlyFans DataScraper v5.4

14 Sep 01:34
35f05fc
Compare
Choose a tag to compare

It's faster and it works

OnlyFans DataScraper v5.3

17 Aug 00:37
Compare
Choose a tag to compare

OnlyFans DataScraper v5.2

04 Aug 21:06
Compare
Choose a tag to compare

OnlyFans DataScraper v5.1

20 Jun 18:58
Compare
Choose a tag to compare

CONFIG CHANGES:

filename_format

Replaced {id} with {media_id}
Added {post_id}
2FA users must add auth_uniq_ cookie to the config
Directory is now named "download_path"
site name prefix in the download_path is now optional, but added by default
"{site_name}"

OPTIMIZATIONS:
Removed some log errors.
Changed socks5 to use socks5h instead.

MODULES:
Fixed auth issues and path issues.

FIXES:
Fixed shutil.SameFileError
I ended up having a 14GB error log because the script was trying to scrape invalid links. Fixed that.

FEATURES:
Ignore free or paid accounts

OFRenamer:
The script will now automatically convert filenames to the format in the config.
You can also use the script separately, just double click start.py

CONTRIBUTORS:
@Balgden (Added Python3 shebang)
This script requires Python 3. On most Linux distributions 'python' is a symlink to python 2. The only exception I'm aware of is Arch, which symlinks to python 3 instead. Luckily a more specific 'python3' is available on all distributions.

Fixes './start_ofd.py' on Ubuntu and other Linux distributions.

OnlyFans DataScraper v5.0

01 Jun 22:58
Compare
Choose a tag to compare

Optimizations:

Implemented A faster way to get your active subscription list.
Implemented A faster way to scrape mass messages.

Overhaul:

Renamed StartDatascraper.py to start_ofd.py
Config will update automatically.

Major directory changes:

"sites" > ".sites"
"settings" > ".settings"

Folder structure by default is now:

Posts > Free > Images/Videos/Etc
Posts > Paid > Images/Videos/Etc

Set sort_free_paid_posts to False if you want to use the original file structure which doesn't separate free/paid posts.

Metadata is now stored in the root of the model folder.

Everything used to be tied to the post API. If a post only had an image, the rest of the APIs would only download images even if they had video and audio files, so you'd be missing out on content basically.

Before:
Post API > Only has image files
Post API > Search for images
Message API > Search for images

Now:
Post API > Only has image files
Post API > Search for image files
Message API > Search for the image, video and audio files

Script will automatically convert files to the new format.

Features:

Added socks5 proxy.

Fixes:

Fixed text not limiting itself.
Text will now be cleaned so it can be a valid filename format.
(Don't use "text" in the filename format, I've warned people multiple times. Don't use it. I don't wanna hear complaints that you have to redownload 10TB worth of data when you've already been warned. I don't care lol.)