[Observability]… | pokt-network/path

Nobody has claimed this yet.

Set the foundation for PATH Grafana dashboards.

Build out the foundational infrastructural for Grafana dashboards in PATH
Use the same patterns as in poktroll to be consistent across all of Grove's stacks
Clearly document how metrics + logs can be accessed and updated across multiple environents

Foundation
- LocalNet: Ensure Loki, Prometheus, Victoria Metrics and Grafana are part of the stack
- Staging: Ensure Loki, Prometheus, Victoria Metrics and Grafana are part of the stack
- Ensure all dashboards (local and staging) are maintain via IaC in the helm-charts repo
Metrics
- Ensure OS level metrics for each service (PATH, Envoy Proxy, etc...) are accessible in a separate dashboard
  - LocalNet (Tilt + Kind)
  - PATH (Staging deployment)
  - Ask @okdas what he recommends for this. Afterwards, look into this reference as another potential starting point.
- Ensure logs are accesible
  - LocalNet (Tilt + Kind)
  - PATH (Staging deployment)
Documentation:
- Development:
  - Document how a backend developer can update the dashboards
  - Lookng into adding Makefile targets to streamline this process (if possible); e.g. export and saving json.
- Access:
  - LocalNet: Document (with links) how anyone can access the LocalNet dashboard
  - Staging: Document (with links) how anyone can access the Staging dashboard

Creator: @HebertCL
Co-Owners: @HebertCL @okdas @Olshansk

We have not checked this project's setup files yet. Start from its README, and see our first-contribution guide for the general steps.

[Observability] Grafana dashboards for local & cloud environments