Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to import database: missing data for column "views" #30

Open
AlyoshaVasilieva opened this issue Feb 9, 2023 · 0 comments
Open

Failed to import database: missing data for column "views" #30

AlyoshaVasilieva opened this issue Feb 9, 2023 · 0 comments

Comments

@AlyoshaVasilieva
Copy link

From a clean clone:

$ sudo docker compose up
[+] Running 4/0
 ⠿ Network sponsorblock-mirror_default  Created                                                                                                                               0.0s
 ⠿ Container postgres-sb-mirror         Created                                                                                                                               0.0s
 ⠿ Container sb-mirror                  Created                                                                                                                               0.0s
 ⠿ Container sponsorblock-mirror        Created                                                                                                                               0.0s
Attaching to postgres-sb-mirror, sb-mirror, sponsorblock-mirror
postgres-sb-mirror   |
postgres-sb-mirror   | PostgreSQL Database directory appears to contain a database; Skipping initialization
postgres-sb-mirror   |
postgres-sb-mirror   | 2023-02-08 23:48:23.986 UTC [1] LOG:  starting PostgreSQL 15.1 on x86_64-pc-linux-musl, compiled by gcc (Alpine 11.2.1_git20220219) 11.2.1 20220219, 64-bit
postgres-sb-mirror   | 2023-02-08 23:48:23.986 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
postgres-sb-mirror   | 2023-02-08 23:48:23.986 UTC [1] LOG:  listening on IPv6 address "::", port 5432
postgres-sb-mirror   | 2023-02-08 23:48:23.987 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres-sb-mirror   | 2023-02-08 23:48:23.990 UTC [23] LOG:  database system was shut down at 2022-11-29 13:32:08 UTC
postgres-sb-mirror   | 2023-02-08 23:48:23.994 UTC [1] LOG:  database system is ready to accept connections
sb-mirror            | Uses SponsorBlock data from https://sponsor.ajay.app/
sb-mirror            | Downloading from mirror: sponsorblock.kavin.rocks
sb-mirror            | receiving incremental file list
sb-mirror            | ./
sb-mirror            | categoryVotes.csv
     30,177,893 100%   18.12MB/s    0:00:01 (xfr#1, to-chk=8/10)
sb-mirror            | lockCategories.csv
     18,444,297 100%   24.46MB/s    0:00:00 (xfr#2, to-chk=7/10)
sb-mirror            | ratings.csv
        924,650 100%    1.21MB/s    0:00:00 (xfr#3, to-chk=6/10)
sb-mirror            | sponsorTimes.csv
    435,421,184 100%   28.53MB/s    0:00:14 (xfr#4, to-chk=5/10)
sb-mirror            | unlistedVideos.csv
      6,468,526 100%   11.82MB/s    0:00:00 (xfr#5, to-chk=4/10)
sb-mirror            | userNames.csv
     17,156,024 100%   14.33MB/s    0:00:01 (xfr#6, to-chk=3/10)
sb-mirror            | videoInfo.csv
sponsorblock-mirror  | Importing database...
    476,180,585 100%   25.84MB/s    0:00:17 (xfr#7, to-chk=2/10)
sb-mirror            | vipUsers.csv
          6,637 100%   14.00kB/s    0:00:00 (xfr#8, to-chk=1/10)
sb-mirror            | warnings.csv
        577,930 100%    1.01MB/s    0:00:00 (xfr#9, to-chk=0/10)
sb-mirror            |
sb-mirror            | sent 209 bytes  received 746,827,143 bytes  18,907,021.57 bytes/sec
sb-mirror            | total size is 985,357,726  speedup is 1.32
sb-mirror            | Starting rsync daemon
postgres-sb-mirror   | 2023-02-08 23:49:26.992 UTC [46] ERROR:  missing data for column "views"
postgres-sb-mirror   | 2023-02-08 23:49:26.992 UTC [46] CONTEXT:  COPY sponsorTimesTemp, line 1548497: "anr6QUZ0mSY,532.5612,537.316,0,0,1,e8d0e34783b3c0adec456bda5eda5cd76ee06b1db4b5b9b4570c4c85aad3cb4f,..."
postgres-sb-mirror   | 2023-02-08 23:49:26.992 UTC [46] STATEMENT:  BEGIN; DROP TABLE IF EXISTS "sponsorTimesTemp"; CREATE UNLOGGED TABLE "sponsorTimesTemp"(LIKE "sponsorTimes" INCLUDING defaults INCLUDING constraints INCLUDING indexes); COPY "sponsorTimesTemp" FROM '/mirror/sponsorTimes.csv' DELIMITER ',' CSV HEADER; DROP TABLE "sponsorTimes"; ALTER TABLE "sponsorTimesTemp" RENAME TO "sponsorTimes"; COMMIT;
sponsorblock-mirror  | Failed to import database: missing data for column "views"
sb-mirror            | Downloading from mirror: sponsorblock.kavin.rocks
sb-mirror            | @ERROR: max connections (1) reached -- try again later
sb-mirror            | rsync error: error starting client-server protocol (code 5) at main.c(1837) [Receiver=3.2.5]
sponsorblock-mirror  | Importing database...
postgres-sb-mirror   | 2023-02-08 23:50:59.514 UTC [46] ERROR:  missing data for column "views"
postgres-sb-mirror   | 2023-02-08 23:50:59.514 UTC [46] CONTEXT:  COPY sponsorTimesTemp, line 1548497: "anr6QUZ0mSY,532.5612,537.316,0,0,1,e8d0e34783b3c0adec456bda5eda5cd76ee06b1db4b5b9b4570c4c85aad3cb4f,..."
postgres-sb-mirror   | 2023-02-08 23:50:59.514 UTC [46] STATEMENT:  BEGIN; DROP TABLE IF EXISTS "sponsorTimesTemp"; CREATE UNLOGGED TABLE "sponsorTimesTemp"(LIKE "sponsorTimes" INCLUDING defaults INCLUDING constraints INCLUDING indexes); COPY "sponsorTimesTemp" FROM '/mirror/sponsorTimes.csv' DELIMITER ',' CSV HEADER; DROP TABLE "sponsorTimes"; ALTER TABLE "sponsorTimesTemp" RENAME TO "sponsorTimes"; COMMIT;
sponsorblock-mirror  | Failed to import database: missing data for column "views"
sponsorblock-mirror  | Importing database...
postgres-sb-mirror   | 2023-02-08 23:52:31.515 UTC [46] ERROR:  missing data for column "views"
postgres-sb-mirror   | 2023-02-08 23:52:31.515 UTC [46] CONTEXT:  COPY sponsorTimesTemp, line 1548497: "anr6QUZ0mSY,532.5612,537.316,0,0,1,e8d0e34783b3c0adec456bda5eda5cd76ee06b1db4b5b9b4570c4c85aad3cb4f,..."
postgres-sb-mirror   | 2023-02-08 23:52:31.515 UTC [46] STATEMENT:  BEGIN; DROP TABLE IF EXISTS "sponsorTimesTemp"; CREATE UNLOGGED TABLE "sponsorTimesTemp"(LIKE "sponsorTimes" INCLUDING defaults INCLUDING constraints INCLUDING indexes); COPY "sponsorTimesTemp" FROM '/mirror/sponsorTimes.csv' DELIMITER ',' CSV HEADER; DROP TABLE "sponsorTimes"; ALTER TABLE "sponsorTimesTemp" RENAME TO "sponsorTimes"; COMMIT;
sponsorblock-mirror  | Failed to import database: missing data for column "views"
postgres-sb-mirror   | 2023-02-08 23:53:23.483 UTC [21] LOG:  checkpoint starting: time
postgres-sb-mirror   | 2023-02-08 23:53:23.618 UTC [21] LOG:  checkpoint complete: wrote 4 buffers (0.0%); 1 WAL file(s) added, 0 removed, 0 recycled; write=0.102 s, sync=0.003 s, total=0.136 s; sync files=53, longest=0.001 s, average=0.001 s; distance=358 kB, estimate=358 kB
sponsorblock-mirror  | Importing database...
postgres-sb-mirror   | 2023-02-08 23:54:04.374 UTC [46] ERROR:  missing data for column "views"
postgres-sb-mirror   | 2023-02-08 23:54:04.374 UTC [46] CONTEXT:  COPY sponsorTimesTemp, line 1548497: "anr6QUZ0mSY,532.5612,537.316,0,0,1,e8d0e34783b3c0adec456bda5eda5cd76ee06b1db4b5b9b4570c4c85aad3cb4f,..."
postgres-sb-mirror   | 2023-02-08 23:54:04.374 UTC [46] STATEMENT:  BEGIN; DROP TABLE IF EXISTS "sponsorTimesTemp"; CREATE UNLOGGED TABLE "sponsorTimesTemp"(LIKE "sponsorTimes" INCLUDING defaults INCLUDING constraints INCLUDING indexes); COPY "sponsorTimesTemp" FROM '/mirror/sponsorTimes.csv' DELIMITER ',' CSV HEADER; DROP TABLE "sponsorTimes"; ALTER TABLE "sponsorTimesTemp" RENAME TO "sponsorTimes"; COMMIT;
sponsorblock-mirror  | Failed to import database: missing data for column "views"

Not clear to me how much this error matters (it seems to be responding to API requests fine?), but it repeats in the logs seemingly forever.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AlyoshaVasilieva