Datadog Concepts
Internal
Overview
Datadog is an observability platform that includes products for monitoring, alerting, metrics, dashboard, big logs, synthetics, user monitoring, CI/CD (how?). Datadog is API driven.
Route of a Metric from Application to Dashboard
Application (specialized library) → DogStatsD → events → Dashboard
The metrics are generated by an application-level library, such as Micrometer.
Name, tags to metric. Statsd. Datadog adds a datadog tag (cluster-name, pod-name)
Metric: eks.smoketest.create_pod.succ from cluster_name. Use the tag as a filter.
Agent
The Datadog agent has a built-in StatsD server, exposed over a configurable port. It's written in Go.
Agent and Kubernetes
TO CONTINUE: https://docs.datadoghq.com/developers/dogstatsd/?tab=kubernetes#
DogStatsD
DogStatsD is a metrics aggregation service bundled with the Datadog agent. DogStatsD implements the StatsD protocol and a few extensions (histogram metric type, service checks, events and tagging).
DogStatsD accepts custom metrics,events and service checks over UDP and periodically aggregates them and forwards them to Datadog.
Events
Events are records of notable changes relevant for managing and troubleshooting IT operations, such as code deployments, service health, configuration changes or monitoring alerts.
Monitor
When something goes wrong, a computer tells you about it. This is what a monitor is. There re different monitor types. The monitor has a query. The monitor has alert conditions.
Unified Service Tagging
There are three reserved tags: "env", "service", "version".
Dashboard
Metrics Explorer
Notebook
Security
User
Service Account
API Key
An API key is required by the Datadog Agent to submit metrics and events to Datadog. The API keys are also used by other third-party clients, such as, for example, the Pulumi Datadog resource provider, which provisions infrastructure on the Datadog backend. API keys are unique to an organization. To see API Keys: Console → Hover over the user name at the bottom of the left side menu → Organization Settings → API Keys.
Application Key
Application keys, in conjunction with the organization’s API key, give users access to Datadog’s programmatic API. Application keys are associated with the user account that created them and by default have the permissions and scopes of the user who created them. To see or create Application Keys: Console → Hover over the user name at the bottom of the left side menu → Organization Settings → Application Keys.