Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repl errors and limitations #1

Open
dryprogrammer opened this issue Jan 17, 2024 · 0 comments
Open

Repl errors and limitations #1

dryprogrammer opened this issue Jan 17, 2024 · 0 comments

Comments

@dryprogrammer
Copy link

Hi, I discovered this from the LangServe blog. Thanks for the repl for a quickstart, but I think it's misleading and maybe a deadend for langchain & repl nix newbies.

Maybe you can elaborate that this is not for deployment, and direct them to a different replit where securing the endpoint is simpler, perhaps with an nginx in front like https://replit.com/@ritza/nix-template

Also Replit nix doesn't allow many pkgs such as pkgs.ollama so it might help others to install a small model to your repl. Llama2 didn't run for me probably due to RAM/Swap space:
https://replit.com/@dryprogrammer/langserve-replit-template

Errors:

entrypoint = "main.py"

main.py should be app/server.py

run = ["sh", "-c", "langserve serve"]

langserve serve should be langchain serve --host 0.0.0.0

Also /pirate-speak/playground/ doesn't work without trailing slash, and even with, it doesn't work.
Screenshot from 2024-01-17 19-18-33

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant