Configure Spark 3 thrift server with Apache Ranger - apache-ranger

I am trying to configure Spark 3.3.0 Thrift Server with Apache Ranger but I cannot find any resources or information for this setup.Any suggestions on how to implement this? Thanks very much!
I already have an STS (kerberos jdbc) turned on and Apache Ranger on a Kerberos authenticated cluster, but I don't know how to integrate STS with Apache Ranger. I have done my research on https://github.com/yaooqinn/spark-ranger, but It's an archived repository and the code doesn't support Spark 3.3.0. Any help would be appreciated.

i think i found the new plugin:
https://kyuubi.readthedocs.io/en/master/security/authorization/spark/install.html
it's working with apache spark 3.x thrift server

Related

How to integrate Rabbitmq authentication (using MQTT) with oauth2

I want to use oauth2 to authenticate and authorize the MQTT protocol in Rabbitmq.
I found out there rabbitmq-auth-backend-oauth2 plugin that helps deploy this purpose.
However, I cannot install this plugin on the Rabbitmq-server as its plugin.
OS: Centos
Rabbitmq 3.7.14
Erlang 21
I installed this plugin with the command, but it's always failure: 
make run-broker RABBITMQ_CONFIG_FILE = demo / symmetric_keys /
rabbitmq
Please let me know the deployment model of this integration and the configuration for rabbitmq, as well as installing the that plugin (of course if needed)

Dockerized WSO2 Identity Server Version 2.3

I am looking for Dockerfiles for the recent WSO 2.3 Identity Server. The files on github seem to be outdated. Is there anything available?
Many thanks!

How to retrieve LDAP data in Grails?

I am trying to use the Grails plugin 'directory services' to access LDAP data. I am unable to configure it in GGTS. Can anyone help me with the code or directions to be used in coding a program for LDAP access in GGTS.
Did you check the documentation http://lr.github.io/directory-service/guide/configuration.html to see how to configure the plugin ?
This is a client and this means you have to install / configure also a ldap server. Have a look at the apache directory project https://directory.apache.org to get a ldap client / server . Afterwards you can connect from Grails as client to the Ldap-Server.

Running an LDAP Server on Cloudbees

I have a simple Grails app that I've written to authenticate against an LDAP server. To develop it, I've installed ApacheDS locally and populated it with an LDIF file. Now I want to deploy it to CloudBees. Is it possible to install an LDAP server on CloudBees?
If not, an alternative seems to be to use the Grails ldap-server plugin. However, it doesn't have any documentation on how to configure it. How do I configure this plugin to load an LDIF on startup?
Unfortunately, running LDAP in a CloudBees app container/stack won't work because in-bound routing to your application port must be over HTTP/HTTPS.
Alternative 1: host the LDAP server outside of CloudBees (like on your own EC2 server)
Alternative 2: [for the highly motivated] you might be able to get a WebSocket gateway of some kind to work, but you'd special code on the client and server side to negotiate the socket stream hand-off outside of the LDAP server and client. [Client -> WS-Client --> CloudBees --> WS-Server --> LDAP Server]
gripe: why can't all protocols support virtual hosting like HTTP? -- that would make them much more Cloud-friendly :(

Deploying Apache Solr

I've been experimenting with Apache SOLR and I'm ready to integrate it with a rails application. However, I'd like to make sure I know how to deploy solr. I currently have the rails application deployed using passenger+nginx. Is it possible to deploy SOLR using nginx as well? If so, how would I do that? Otherwise, what is the preferred method of deployment? Thanks!
Solr needs to run in a Java EE application server. You can use Jetty or Tomcat. Nginx will act as a proxy via AJP or something simliar to forward all RESTless request to Solr. I haven't used my ajp with nginx but I have read about this. Essentially you will have a Java EE application server, Rails server, nginx, passenger and ajp proxy running all at the same time.
You can also setup a proxy pass and there is a tutorial here. Explore different options to see which one is bet for you.

Resources