Monitoring & Logging in DevOps and AI

Section 02: Live Class Curriculum

• Lesson 01: Introduction to Monitoring and Prometheus

  • Monitoring and Logging: Overview

  • Monitoring Fundamentals

  • Assisted Practice: Setting up Basic Infrastructure Monitoring Using a Free Monitoring Tool (Example: Zabbix) (Prerequisite: Familiarity with Basic System Administration Tasks)

  • Introduction to Prometheus

  • Getting Started with Prometheus

  • Assisted Practice: Setting up a Local Prometheus Instance and Exploring Its Web Interface (Prerequisite: Basic Understanding of Web Applications)

  • Lesson End Project: Running Prometheus as a Docker Container for Monitoring

• Lesson 02: Implementing Monitoring with Prometheus

  • Metrics and Exporters

  • PromQL: Prometheus Query Language

  • Assisted Practice: Crafting Basic Queries in PromQL

  • Lesson End Project: Monitoring Apache Server Metrics Using Prometheus

• Lesson 03: Advance Concepts of Prometheus in Monitoring

  • Instrumentation in Monitoring

  • Assisted Practice: Adding Instrumentation to Java Application

  • Recording Rules

  • Alerting in Prometheus

  • Assisted Practice: Configuring Alertmanager for Email Notifications

  • Pushgateway

  • Assisted Practice: Automating Metric Pushing with Cron Jobs

  • Lesson End Project: Monitoring MySQL Database Using Prometheus and Setting Up Alerts

• Lesson 04: Visualization in Monitoring Using Grafana

  • Introduction to Grafana

  • Setting up Grafana

  • Assisted Practice: Setting up a Grafana Instance (Prerequisite: Basic Understanding of Web Application Configuration)

  • Assisted Practice: Building a Multi-Panel Dashboard Comparing Resource Utilization across Different Servers

  • Assisted Practice: Configure Email Alerts to Notify Engineers When Critical System Metrics Exceed Predefined Thresholds

  • Integrating Grafana with Prometheus

  • Assisted Practice: Creating a Grafana Dashboard Using PromQL Queries to Visualize Specific Application Metrics Directly from Prometheus (Prerequisite: Understanding of Basic PromQL Syntax)

  • Assisted Practice: Installing Grafana on a Linux server and connecting it to a Prometheus data source to collect metrics from your infrastructure.

  • Lesson End Project: Monitoring Python Web Application using Prometheus and Grafana

• Lesson 05: Centralized Logging and Monitoring

  • Introduction to Logging and ELK Stack

  • Components of ELK Stack

  • Assisted Practice: Setting up and Configuring Elasticsearch for Log Storage

  • Assisted Practice: Building Logstash Pipelines for Centralized Collection

  • Assisted Practice: Building Dashboards and Visualizations in Kibana

  • Advanced Log Collection with ELK Stack

  • Assisted Practice: Configuring Filebeat to Collect Logs from Applications and Systems

  • ELK Stack Integrations and Automation

  • Assisted Practice: Building an Automated Log Processing Pipeline with Kafka and ELK Stack