How do I use this to download/seed a webtorrent

[ghost]

I'm writing a peertube mirror in python that's supposed to use libtorrent, but I can't seem to get it to work. The status is stuck at "downloading_metadata".

• video metadata in question: https://tilvids.com/api/v1/videos/2598
• magnet link (this works on https://btorrent.xyz/)

$ uname -mor
5.16.11-lp153.2.g90630c5-default x86_64 GNU/Linux
$ python --version
Python 3.9.10
$ python -c "import libtorrent; print(libtorrent.version)"
2.0.5.0

Code

Mostly copied from the example.

import sys
import time
from pathlib import Path

import libtorrent as lt

ses = lt.session({'listen_interfaces': '0.0.0.0:6881'})

download_dir_path = Path("/tmp/tilvids/")
download_dir_path.mkdir(parents=True, exist_ok=True)
download_file_path = download_dir_path / "video"
magnet_uri = "magnet:?xs=https%3A%2F%2Ftilvids.com%2Flazy-static%2Ftorrents%2Fd86fade7-561c-481a-b5bb-e8421177638c-1080.torrent&xt=urn:btih:9ae6455145efe03ae11f4da742bbfddadc3ffe18&dn=Eternal+Inflation%3A+The+Theory+of+Infinite+Big+Bangs&tr=https%3A%2F%2Ftilvids.com%2Ftracker%2Fannounce&tr=wss%3A%2F%2Ftilvids.com%3A443%2Ftracker%2Fsocket&ws=https%3A%2F%2Ftilvids.com%2Fstatic%2Fwebseed%2Fd86fade7-561c-481a-b5bb-e8421177638c-1080.mp4"
add_torrent_params = lt.parse_magnet_uri(magnet_uri)
add_torrent_params.save_path = str(download_file_path)
h = ses.add_torrent(add_torrent_params)

s = h.status()
print('starting', s.name)

while (not s.is_seeding):
    s = h.status()

    print(
        '\r%.2f%% complete (down: %.1f kB/s up: %.1f kB/s peers: %d) %s' % (
            s.progress * 100, s.download_rate / 1000, s.upload_rate / 1000,
            s.num_peers, s.state), end=' '
        )

    alerts = ses.pop_alerts()
    for a in alerts:
        if a.category() & lt.alert.category_t.error_notification:
            print(a)

    sys.stdout.flush()

    time.sleep(1)

print(h.status().name, 'complete')

Output

0.00% complete (down: 0.0 kB/s up: 0.0 kB/s peers: 0) downloading_metadata Eternal Inflation: The Theory of Infinite Big Bangs (https://tilvids.com/tracker/announce)[127.0.0.1:6881] skipping tracker announce (unreachable) "" (1)
Eternal Inflation: The Theory of Infinite Big Bangs (wss://tilvids.com:443/tracker/socket)[127.0.0.1:6881] unsupported URL protocol "" (1)
Eternal Inflation: The Theory of Infinite Big Bangs (https://tilvids.com/tracker/announce)[192.168.2.57:6881] certificate verify failed "" (1)
Eternal Inflation: The Theory of Infinite Big Bangs (wss://tilvids.com:443/tracker/socket)[192.168.2.57:6881] unsupported URL protocol "" (1)

[arvidn]

The &xs= argument is not supported by libtorrent. metadata can only be downloaded from bittorrent peers, via the metadata extension. If you have a URL to the torrent file, you could download it yourself, and then add it to libtorrent.

[ghost]

Hi, unfortunately, that doesn't work either.

downloaded torrent to  /tmp/my second animation-720p.torrent
starting ezgif.com-gif-maker(1).mp4 720p.mp4
0.00% complete (down: 0.0 kB/s up: 0.0 kB/s peers: 1) downloading ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[127.0.0.1:6881] unsupported URL protocol "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[192.168.2.57:6881] unsupported URL protocol "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[172.17.0.1:6881] unsupported URL protocol "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (https://video.ploud.fr/tracker/announce)[127.0.0.1:6881] skipping tracker announce (unreachable) "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (https://video.ploud.fr/tracker/announce)[172.17.0.1:6881] skipping tracker announce (unreachable) "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (https://video.ploud.fr/tracker/announce)[192.168.2.57:6881] certificate verify failed "" (1)

This is the updated code that also downloads the torrent

"""
import sys
import time
from pathlib import Path

import requests
import libtorrent as lt

torrent_path = Path("/tmp/my second animation-720p.torrent")
if not torrent_path.is_file():
    response = requests.get("https://video.ploud.fr/download/torrents/f7fb42c0-d45e-4395-a052-d0cdf4bcc3f2-720.torrent")
    torrent_path.write_bytes(response.content)
    print("downloaded torrent to ", torrent_path)

ses = lt.session({'listen_interfaces': '0.0.0.0:6881'})
download_dir_path = Path("/tmp/tilvids/")
download_dir_path.mkdir(parents=True, exist_ok=True)
download_file_path = download_dir_path / "video"
h = ses.add_torrent({
    "ti": lt.torrent_info(str(torrent_path)),
    "save_path": str(download_dir_path)
})


s = h.status()
print('starting', s.name)

while (not s.is_seeding):
    s = h.status()

    print(
        '\r%.2f%% complete (down: %.1f kB/s up: %.1f kB/s peers: %d) %s' % (
            s.progress * 100, s.download_rate / 1000, s.upload_rate / 1000,
            s.num_peers, s.state), end=' '
        )

    alerts = ses.pop_alerts()
    for a in alerts:
        if a.category() & lt.alert.category_t.error_notification:
            print(a)

    sys.stdout.flush()

    time.sleep(1)

print(h.status().name, 'complete')

The torrent works on https://btorrent.xyz/view and can be played from the peertube instance.

If this is better suited in a bug report, I can write one.

[ghost]

Even though I'm able to download the file on my VPS, it doesn't seem like webtorrents are working as I don't see the number of seeds increase when downloading it from my browser.

starting ezgif.com-gif-maker(1).mp4 720p.mp4
100.00% complete (down: 0.0 kB/s up: 0.0 kB/s peers: 0) seeding ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[127.0.0.1:6881] unsupported URL protocol "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[172.17.0.3:6881] unsupported URL protocol "" (1)
ezgif.com-gif-maker(1).mp4 720p.mp4 (https://video.ploud.fr/tracker/announce)[127.0.0.1:6881] skipping tracker announce (unreachable) "" (1)
100.00% complete (down: 0.0 kB/s up: 0.0 kB/s peers: 0) seeding ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[127.0.0.1:6881] unsupported URL protocol "" (2)
ezgif.com-gif-maker(1).mp4 720p.mp4 (wss://video.ploud.fr:443/tracker/socket)[172.17.0.3:6881] unsupported URL protocol "" (2)
100.00% complete (down: 0.0 kB/s up: 0.0 kB/s peers: 0) seeding

At home, it looks like ezgif.com-gif-maker(1).mp4 240p.mp4 (https://video.ploud.fr/tracker/announce)[192.168.2.57:6881] certificate verify failed "" (1) is the thing that's blocking. I'll update ca-certificates and see if that's the problem...

[arvidn]

support for the webtorrent protocol is in the master branch of libtorrent

[ghost]

Thank you. That was it.

For anybody else reading: webtorrent support is in the master branch, but you must enable it when compiling.

with cmake (which I use since the others won't work) you need to add -Dwebtorrent=ON