Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scraper: Avoid storing the same message #28

Open
isc-hemc opened this issue Oct 15, 2019 · 0 comments
Open

Scraper: Avoid storing the same message #28

isc-hemc opened this issue Oct 15, 2019 · 0 comments
Labels
enhancement New feature or request mongo MongoDB python Related language
Milestone

Comments

@isc-hemc
Copy link
Owner

By the moment the mongo helper class in the scraper module doesn't validate if the document trying to insert already exists, implement this functionality, if the document's message id already exists (not _id, this _id it's created by mongo) only update the message not re-insert it.

@isc-hemc isc-hemc added enhancement New feature or request mongo MongoDB python Related language labels Oct 15, 2019
@isc-hemc isc-hemc added this to the TT1 milestone Oct 15, 2019
@isc-hemc isc-hemc removed this from the TT1 milestone Nov 4, 2019
@isc-hemc isc-hemc added this to the TT1.5 milestone Nov 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request mongo MongoDB python Related language
Projects
None yet
Development

No branches or pull requests

1 participant