The Phoenix Data Conference on October 29th 2016 was the place to be for Arizona’s biggest big data event. Prominent companies in Big Data and Analytics assembled to spread their wisdom and experience to a mixed audience of experts and newbies hungry to explore this hot and dynamic field. Speakers from Cloudera, Hortonworks, MapR, Amazon, Microsoft to name some, demonstrated the case studies of their customers and valuable tips for setting up a high performing big-data environments. This was the third Data Conference in the valley organized by Clairvoyant along with their sponsors, the popularity and anticipation of this event skyrocketing through the years. It was impressive to see the highly scalable and multitude of support on Azure HDInsight, Microsoft’s offered Hadoop distribution, demonstrated by Brig Lamoreaux during his presentation on Predictive Maintenance for Aerospace, where he went over the architecture and tools used for their use case. We were…
Author: Nithya Koka
Migrate Cloudera SCM Database from Embedded PostgreSQL to MySQL
If the cloudera EDH was setup using the embedded Postgresql DB on the cluster, it is desired and often required to migrate to an external DB, especially for production environment. It is possible to migrate the cloudera management services databases (activity monitor, service monitor, report manager, host monitor) on an external Postgresql/MySQL DB from the cloudera manager console, but the scm-db would still use the embedded Postgresql. The scm-db contains all the information about the services configured, their role assignments, configuration history, commands, users, and running processes. This is a relatively small database (<100 MB), and is the most important to back up and migrate. A monitoring database contains monitoring information about service and host status. In large clusters, this database can grow large. The following steps guide through the process of migrating the scm-db from the embedded postgres to external mysql instance. Helpful Vantage Point source: http://www.cloudera.com/documentation/enterprise/latest/images/cm_arch.png 1. Stop all cluster services including…