Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic Authentication not working #329

Open
mersed opened this issue Aug 22, 2021 · 0 comments
Open

Basic Authentication not working #329

mersed opened this issue Aug 22, 2021 · 0 comments

Comments

@mersed
Copy link

mersed commented Aug 22, 2021

Platform for execution: aws - emr
Emr version: emr-5.33.0
Spark version: 2.4.7 - amzn1
Solr version: 8.9.0

Execution with arguments:
spark-submit --deploy-mode cluster --master yarn --conf spark.yarn.submit.waitAppCompletion=true --conf spark.driver.extraJavaOptions=-Dbasicauth=admin:test1234 --conf spark.executor.extraJavaOptions=-Dbasicauth=admin:test1234 --py-files s3a://my-data-scripts/pydependencies.zip --files s3a://my-data-scripts/config/config.emr.ini --jars /home/hadoop/spark-solr-3.9.0-shaded.jar s3a://emr-openaccess-scripts/main.py step_6

I am using spark-solr to feed data from spark to solr for a while now. I dont have any issues, and I usually have process which will run for 2 hrs, feeding more then 80 millions of records. I was doing this all the time without any kind of issues.

However, after adding basic authentication to the solr side, I cannot make this work. I provided parameters as per documentation, but I am still getting 401 from solr side during execution.

I am not sure am I doing something wrong, or its the issue with versions I am using on spark-solr, solr or spark side? Credentials provided are definitely ok, and I am able to login to the solr admin ui without any kind of issues using these creds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant