Skip to main content

Observability with prometheus (Introduction)

Introduction to Prometheus: Simplifying System Monitoring

Prometheus is a powerful open-source tool for monitoring and alerting systems. Created in 2012 at SoundCloud, it has been widely adopted by companies worldwide and boasts an active community of developers and users. In 2016, Prometheus became part of the Cloud Native Computing Foundation, alongside Kubernetes.

What is Prometheus?

Prometheus collects data as time series, meaning numerical metrics are stored with timestamps. For example, a web server could track request times or the number of active connections. These metrics can include labels (key-value pairs) to add context.

Example:
If your web application is running slow, Prometheus can provide insights. For instance, it might reveal a spike in request numbers, helping you identify the issue and add resources to handle the load.

Key Features

  • Multi-dimensional data model: Metrics are identified by name and key-value pairs.
  • PromQL: A powerful query language for analyzing metrics.
  • Standalone operation: Prometheus servers don’t depend on distributed storage.
  • Pull-based collection: Metrics are fetched via HTTP, with optional support for push via a gateway.
  • Service discovery: Automatically finds targets or uses static configuration.
  • Visualization: Integrates with tools like Grafana for detailed dashboards.

Core Components of Prometheus

Prometheus is modular and includes several components:

  1. Prometheus server: Collects and stores time series data.
  2. Client libraries: Instrument your applications for custom metrics.
  3. Push Gateway: Handles data from short-lived jobs.
  4. Exporters: Connects Prometheus to services like HAProxy or StatsD.
  5. Alertmanager: Manages alerting rules and notifications.
  6. Support tools: Additional utilities to enhance functionality.

How Does Prometheus Work?

  • Prometheus scrapes metrics from instrumented applications or a push gateway.
  • It stores the collected data locally on the Prometheus server.
  • Rules can aggregate data or create alerts based on thresholds.
  • Tools like Grafana allow you to visualize the data.

When Should You Use Prometheus?

Prometheus is ideal for:

  • Monitoring numerical metrics like CPU usage, request rates, or memory consumption.
  • Dynamic architectures such as microservices.
  • Diagnosing issues during outages, thanks to its reliable and independent nature.

When Not to Use Prometheus

If you require absolute precision (e.g., per-request billing), Prometheus is not the best option. It prioritizes reliability over 100% accuracy and works best as a general monitoring solution rather than a billing tool.

Conclusion

Prometheus is an essential tool for modern system monitoring, offering simplicity, reliability, and scalability. Its ability to provide insights into metrics makes it invaluable for dynamic infrastructures like microservices. While it excels in general monitoring, for specific needs like precise billing, it’s better to complement Prometheus with other tools.


Comments

Post a Comment

Popular posts from this blog

FastAPI Instrumentalisation with prometheus and grafana Part1 [Counter]

welcome to this hands-on lab on API instrumentation using Prometheus and FastAPI! In the world of modern software development, real-time API monitoring is essential for understanding usage patterns, debugging issues, and ensuring optimal performance. In this lab, we’ll demonstrate how to enhance a FastAPI-based application with Prometheus metrics to monitor its behavior effectively. We’ve already set up the lab environment for you, complete with Grafana, Prometheus, and a PostgreSQL database. While FastAPI’s integration with databases is outside the scope of this lab, our focus will be entirely on instrumentation and monitoring. For those interested in exploring the database integration or testing , you can review the code in our repository: FastAPI Monitoring Repository . What You’ll Learn In this lab, we’ll walk you through: Setting up Prometheus metrics in a FastAPI application. Instrumenting API endpoints to track: Number of requests HTTP methods Request paths Using Grafana to vi...
Post a Comment
Read more

Join Ubuntu 20.04 to Active Directory with SSSD and SSH Access

Join Ubuntu 20.04 to Active Directory with SSSD and SSH Access  Overview This guide walks you through joining an Ubuntu 20.04 machine to an Active Directory domain using SSSD, configuring PAM for AD user logins over SSH, and enabling automatic creation of home directories upon first login. We’ll also cover troubleshooting steps and verification commands. Environment Used Component Value Ubuntu Client       ubuntu-client.bazboutey.local Active Directory FQDN   bazboutey.local Realm (Kerberos)   BAZBOUTEY.LOCAL AD Admin Account   Administrator Step 1: Prerequisites and Package Installation 1.1 Update system and install required packages bash sudo apt update sudo apt install realmd sssd libnss-sss libpam-sss adcli \ samba-common-bin oddjob oddjob-mkhomedir packagekit \ libpam-modules openssh-server Step 2: Test DNS and Kerberos Configuration Ensure that the client can resolve the AD domain and discover services. 2.1 Test domain name resol...
Post a Comment
Read more

Observability with grafana and prometheus (SSO configutation with active directory)

How to Set Up Grafana Single Sign-On (SSO) with Active Directory (AD) Grafana is a powerful tool for monitoring and visualizing data. Integrating it with Active Directory (AD) for Single Sign-On (SSO) can streamline access and enhance security. This tutorial will guide you through the process of configuring Grafana with AD for SSO. Prerequisites Active Directory Domain : Ensure you have an AD domain set up. Domain: bazboutey.local AD Server IP: 192.168.170.212 Users: grafana (for binding AD) user1 (to demonstrate SSO) we will end up with a pattern like this below Grafana Installed : Install Grafana on your server. Grafana Server IP: 192.168.179.185 Administrator Privileges : Access to modify AD settings and Grafana configurations. Step 1: Configure AD for LDAP Integration Create a Service Account in AD: Open Active Directory Users and Computers. Create a user (e.g., grafana ). Assign this user a strong password (e.g., Grafana 123$ ) and ensure it doesn’t expire. Gather Required AD D...
Post a Comment
Read more