If you have an OpenShift (Origin or Enterprise) environment, you have likely deployed the EFK (elasticsearch, fluentd, and kibana) stack to help operators and developers easily view log files. Referred to as the Aggregated Container Logs in OSE, this stack is very useful and should be deployed in most situations. But log data tends to grow rapidly, especially in development environments with a large amount of projects and containers being deployed in a CI/CD pipeline, and cleanup is necessary; enter curator.
Curator allows operators to define how long elasticsearch indices should be retained. On a defined daily schedule it will purge any qualified indices from elasticsearch. Unfortunately, curator has only been added into the OpenShift Origin version of software, and is not yet included in the OpenShift Enterprise deployments (as of 3.2). Fortunately, version 3.1.1 and 3.2 of the EFK images do include admin credentials that can be used to authenticate a manually deployed curator template.
A few notes about these steps:
Commands are run with a cluster-admin authorization
The project we are using for logging is called ‘logging’
The logging-es deployment configuration specifies version 3.1.1 or 3.2
We are setting the defaults with environment variables within the yaml file, which can be done outside of this file as well
Kyle has been at the forefront of open source and transformative solutions throughout his IT career spanning a number of large North American organiztions. From designing HPC solutions, to archecting complex Container solutions, Kyle provides deep consulting on today’s greatest IT challanges.
As a partner at Arctiq, Kyle focusses on the following core competencies:
Architecture and design leadership
Open source solution focused on modern platforms and disruptive technologies
DevOps consulting and culture conditioning
Virtualization, containers, and microservices
Strategic business planning and process execution
Mike’s business and IT background with over 20 years experience led to the formation of Arctiq’s BPM focused business consulting practice. Business case development, technical process improvement, and consulting on DevOps culture are the foundations of this practice.
As a partner at Arctiq, Mike is prime on:
Developing and delivering Arctiq’s business-focused consulting services
Managing Arctiq’s business operations, ensuring we practice what we preach
Automating and integrating back end processes using a DevOps approach to operations management and visibility
Building an open ecosystem of technology and delivery partners
Delivery Project Management services for complex Arctiq engagements
With design and solution architecture being a primary focus of his career, Aly has spent a great deal of time problem solving complex issues, creating designs and implementing infrastructure solutions. Having worked with multinational companies, he has spent a great deal of time working on globe spanning projects, including classified and bleeding edge technologies. Having a deep background working with security focused clients Aly has a strong knowledge base with regards to system compliance, audits and security hardening. He focuses on core technologies that run deep into the OS including kernel tuning, performance driven solutions and highly secure systems as well as a passion for development and writing code to help automate and streamline tasks.
Outside of Arctiq, Aly can be found spending time with this family, developing code, learning the next great technology and spending time outdoors.
Aly’s focus at Arctiq is in the following key areas:
Container and Orchestration - Docker, Kubernetes and Openshift
DevOps Consulting - Team and culture improvements, development and R&D
With the bulk of his career focused on infrastructure solution architecture and implementation, Shea now brings that knowledge into the development space. Working with software development and infrastructure teams, Shea focuses on improving technology processes through automation and collaboration tooling and culture changes. Being a technologist, Shea is happiest when found exploring emerging technologies and applying them to real-world customer challenges.
Outside of the office Shea can be found out with his friends enjoying a Jays game, being active, or hunting down a new craft brew.
Along with an eye on security processes and partnerships, Shea’s focus at Arctiq is in the following key areas:
Automation & self-service of infrastructure systems
Container platform deployment and training
CI/CD pipeline development with integrated security
DevOps culture improvements through process optimization and collaboration tooling
Tim has spent the bulk of his career in the solution architecture space, problem solving and designing solutions to meet very specific needs. Having worked across many vertical and technology areas, Tim applies this expertise to his work with Arctiq’s clients.
Along with marketing and website responsibilities, Tim’s focus at Arctiq is in the following key areas:
Automation - Ansible, Puppet
Foundations - Red Hat Enterprise Linux, VMware, Cloud (AWS, GCE)
DevOps Consulting - Team and culture improvements, workflow and process improvements
Daniyal has served his time at all levels of development, working his way up to Arctiq. He has a varied knowledge of programming languages and a wealth of problem solving experience. Daniyal is intrigued by Big Data and Mobile Development but Daniyal’s focus is now on his newfound love - DevOps.
Daniyal enjoys helping customers by automating processes with Ansible, building CI/CD Jenkins pipelines on OpenShift and establishing infrastructure management with Satellite.
When Daniyal is not at Arctiq, he enjoys soccer, travelling, and cars (in that order). Daniyal also holds a Honours degree in Computer Science from the Lassonde School of Engineering in Toronto.
Throughout his early career, Jacob has spent time in development and system administration where he gained knowledge in production programming and basic network architecture. Transitioning to DevOps, Jacob is taking his skills from his past work and school experience and adapting quickly.
Jacob has taken a focus on Satellite for infrastructure management, Ansible for IT automation, and Red Hat Enterprise Linux for server foundation.
Outside of Arctiq, Jacob spends time learning new technologies and frameworks to continue making his IT knowledge stronger. One of his favourite things to do is to build projects with his multiple Raspberry Pis.
Through nearly all sizes of enterprise, Aaren has experience from end-user support, application deployment, through to system administration. Combined over 6 years, he is versed in enterprise technology architectures, data management, open-source methodology, systems compliance and general infrastructure technology. While neither for or against ‘DevOps’, he believes in the benefits that such methodologies provide, should any enterprise be willing to embrace change.
Aside from Arctiq, Aaren enjoys time with his wife and two daughters, deploying tech in his home-lab, admiring electric cars, and enjoying the outdoors.
Aaren tends to focus in the following key areas:
Essentials - RHEL, RHV, GlusterFS, openZFS
Automation & Languages - Ansible, Bash, Python
Infra & Storage - practices and training, data integrity
DevOps Consulting - team and culture improvements, legacy modernization