Production Ready Private Cloud Templates

About ELK Stack

As applications grow and become more distributed, focusing on business metrics and true performance/uptime is key to measuring your success. Without proper tooling, it can be difficult to derive those key performance metrics and the data to support them. This platform is the next generation of application metric capturing and analysis. It includes Elasticsearch for data search and analytics, Logstash for centralized logging and log parsing, and Kibana for data visualization.

Our ELK Stack Architecture

By running all services on every node, we can achieve true horizontal log scaling with minimal difficulty by leveraging Neutron software- defined networking. This benefit is most apparent on a cloud computing platform, because you can grow your logging infrastructure alongside your application.

Design Specifications

• Logstash chooses Elasticsearch Data Index sizes, which can be tailored to your log data for best analysis performance.
• While the template allows for as few as one Elasticsearch node, we recommend a minimum of three for redundancy and data access speed.
• You can segment your logging agents to point to any Logstash server which allows for horizontal growth of Logstash endpoints. When one Logstash server is overwhelmed, you can point your agents to another Logstash server.
• For long term storage, you can stream logs to an additional endpoint more appropriate for archival such as Hadoop and maintain a short term expiry time on your Elasticsearch log data.