If you are configuring the Hue load balancer with Apache httpd 2.4 and TLS certificates, there is a chance that you may end up with errors. The httpd proxy will check the certificates of the target systems and if they do not pass some basic consistency checks, the proxied connection fails. This could happen if you are using self-signed certificates or a private certificate authority. The subject of the target certificate may be incorrect (ie the CommonName or CN may be wrong in the cert) or the subjectAlternativeName (SAN) may not match the subject. Error messages in the Hue httpd logs in /var/log/hue-httpd/error_log may include: AH01084: pass request body failed to AH00898: Error during SSL Handshake with remote server returned by Disabling target system certificate checks is a temporary solution. Add the following lines to the Hue load balancer httpd.conf. SSLProxyCheckPeerCN off SSLProxyCheckPeerName off If using Cloudera Manager to configure…
Tag: Cloudera
Installing Livy on a Hadoop Cluster
Purpose Livy is an open source component to Apache Spark that allows you to submit REST calls to your Apache Spark Cluster. You can view the source code here: https://github.com/cloudera/livy In this post I will be going over the steps you would need to follow to get Livy installed on a Hadoop Cluster. The steps were derived from the above source code link, however, this post provides more information on how to test it in a more simple manner. Install Steps Determine which node in your cluster will act as the Livy server Note: the server will need to have Hadoop and Spark libraries and configurations deployed on them. Login to the machine as Root Download the Livy source code cd /opt wget https://github.com/cloudera/livy/archive/v0.2.0.zip unzip v0.2.0.zip cd livy-0.2.0 Get the version of spark that is currently installed on your cluster Run the following command spark-submit –version Example: 1.6.0 Use this value in downstream commands as…